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ing to the Ph.D. degree at Princeton University. Open to men 
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are normally renewable. 

Fellows will be engaged in part-time research in the gen- 
eral area of psychological measurement at the offices of the 
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MATRIX REPRESENTATION OF MODELS FOR THE ANALYSIS 
OF VARIANCE AND COVARIANCE* 


PHILLIP JUSTIN RULON 
HARVARD UNIVERSITY 


Beginning students of analysis of variance frequently find that 
the explanations concerning numbers of degrees of freedom are rather 
more mystical than explanatory, and that the dependencies and in- 
dependencies among parameters and linear restraints are not sys- 
tematically covered or explicitly presented. It is the purpose of this 
paper to set forth the simple matrix representation of these models 
in a way which has been found useful for teaching purposes, and may 
be found of some value in the setting up of mathematical models for 
experimental designs calling for the analysis of variance or the analy- 
sis of covariance. 

The system I shall portray is a more or less natural outgrowth 
of suggestions made by Dr. R. C. Bose, with whom I have discussed 
some of the features very slightly. I am also indebted to Professor 
Frederick Mosteller for assistance with the mechanics of some of the 
models. Any deficiencies which the system may have are not to be 
laid to the doors of these gentlemen, however, as they have not had 
any opportunity to go over the material at any length. 

I should say also that there is no new contribution to theory in- 
volved. And I cannot assert that there is any new contribution of 
any other sort, because I have not corresponded with enough people 
on the subject to be sure that the whole system does not already exist 
in some publication or another. And I have not found the time to 
make any exhaustive search of the literature. All I can say is that I 
haven’t seen the method presented anywhere. I have been told that 
Professor Henry Mann of the Ohio State University uses some such 
system in his teaching. This information came through Mr. David 
Bakan of Ohio State, and unfortunately my request for a copy of 
Professor Mann’s materials yielded the reply that he had no copy of 
his work at hand to send me. 

In order to simplify the presentation I shall use throughout the 
variance ratio test, employing Snedecor’s F in all cases, instead of 
going to the trouble of converting to natural logarithms for the Fish- 


*Address of the retiring President of The Psychometric Society, delivered at 
Denver, Colorado, September 7, 1949. 
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er z test, or taking the square root for the ¢ test where it would be 
appropriate to do so. 
I shall express F' as 
Q,— Qu. 
fi 
Qu 
he 


following the notation employed by Professor R. W. B. Jackson and 
others, except that I use Q for the quadratic function which he rep- 
resents by 7’. 

As one of the simplest possible cases, let us consider a set of nine 
observations X,, X., X;,-°+:, X» drawn at random from a normally 
distributed population, concerning which we wish to test the hypothe- 
sis that the central tendency a is 0. Clearly the expected value of 
X, in successive samples is the unknown value of a, and this is true 
also for the expected value of each of the other X’s. We may then 
write 





, (1) 








E(X,) =a 
R(x) =e 
E(X,) =a 
(2) 
E(X,) =a. 


The matrix of coefficients of the unknown parameter a takes the 
very simple form 


—_ 


9 rows. (3) 














1 


Since no determinant of order greater than 1 may be written from 
this matrix, the rank of the matrix is unity and the estimation space 
has rank unity, leaving the remaining 8 dimensions of the sample 
space as the error space, of rank 8. So the number of degrees of free- 
dom for error is 8. This is the f. of our expression for F. The Q. 
will come from minimizing 
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Q= (X,— A)? + (X,—A)? + (X;—A)? +--- + (Xy—A)? (4) 
with respect to A, solving for the value of A at the minimum, and 
substituting that solution in Q, getting 

1? = 
Qa=—> (a, Z.)*; 
9 oa 


where 4% (5) 
X.=—)> X,. 
9 sa 


I beg your forgiveness for being so pedestrian in my presenta- 
tion of this rather simple case. I wanted to show as quickly as pos- 
sible what steps I shall be talking about in a minute when I get to 
cases where the details of the computations would take too much of 
your time if spelled out. Also it is of interest to note that the very 
simplest case works out in a way consistent with the more elaborate 
ones. This is fairly important in the teaching of the method to be- 
ginning students. They don’t have anything to unlearn. 

In our expression (1) for F, the Q, is in general computed by 
minimizing 


Q=3 (X,—A)? (6) 


after the hypothesis value has been substituted in it for A. In the 
present example this determination is trivial, since the replacement 
of A by 0 gives immediately 


9 
Q,=> X.’. (7) 
8=1 
There remains only to determine /, in the expression for F. This is 
the number of independencies in the statement of the hypothesis a = 0 
and is obviously just 1. We therefore have for F 











Qr—Q. Qa 
fi fe 
3Xe—3 (X,—X,) 
1 
= “ . (8) 
3 (X,—X.)? 


s=1 





8 
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Showing that the square root of this is the usual ¢ for such a 
test can be left as an exercise for some of our students. What we 
want to notice is that while the f, = 1 came from the number of in- 
dependent statements in the hypothesis being tested, it also comes 
from a difference between the ranks of two error spaces. When the 
parameter a was being estimated, the error space was of rank 8. 
Under the hypothesis that a = 0, the error space is of rank 9. The 
difference is f,;, and we could have written our F thus: 


Q,—Q 
9—8 
Q. 

8 








? 





or in general, 


Q, a OQ. 

Sak te pais i. 

Qu 
fa 

Actually the matrix representation of the model didn’t have a 
chance to be very useful in this simple case. We have to have a case 
at least one step more complicated to see the value of the matrix ma- 
chinery. Suppose n, + », = WN scores are at hand for the N individ- 
uals in a parallel group experiment. Let an individual score be rep- 
resented by X,; where s = 1, 2, the group number, and t= 1, 2, 
3,-:-, ,, the number of the individual within his group. Then the 
expected value of X,; in successive experiments will be 


E(X;:) =at+Z,, s=1,2, (10) 








al (9) 


in which a is the part common to all the pupils and #, and f, are the 
pacts ascribed to the respective groups. The expectations of the scores 
in successive experiments may be written thus: 
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E(Xn) =a +B, +0 fe 
E(Xy.) =a +B, + 0- fe 
E(Xy) =a+ fi +0-f 


E(Xim) =a + 6, + 0- fe 
E(X2) =a+0-6,+ f 
E(X2)=at+0-6+ 
E (X23) =a + 0-6, + fe 


E(Xonz) =a +0- fi '+ fo. 
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(11) 


So the matrix of coefficients of the unknowns in the right-hand side is 


et et &% 


bo bo bo 


2 


t a ~, fs 
1 : i *g 
2 > 4 F 
3 : & © 


ot ae i 


1 . @& 4 
2 > i - 3 
3 ee 














Ng a. @ 4 


(12) 


The top 7, rows of the matrix are all alike, so even the beginning 
student can see that a determinant which includes any two of these 
rows must equal 0. Similarly the bottom n, rows are alike, so the 
inclusion of any two of them in a determinant will cause it to van- 
ish. So no more than one row from the top half and one row from the 
bottom half of the matrix can be included in a non-vanishing deter- 
minant, and the rank of the matrix is 2. Since the student may wish 
actually to write out the non-vanishing determinant in more compli- 
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cated models, we may have him here take the first row in each half 
for a new matrix 


(13) 


’ 


ae Be 
: 2. 4 


and notice that any second-order determinants he writes from this 
will be non-vanishing. | 

However, the interesting thing is to go back to the original ma- 
trix and border it with the coefficients of the columns to show that 
the last two columns add up to the first. The bordering 1 row written 
at the bottom will be 











—_| &*q 


and if we now consider the original matrix to be augmented by this 
row, the augmented matrix is seen to have rank 8 , which is the num- 
ber of columns and also the number of parameters, a, 6,, and /.. 
Furthermore, the student’s reduced matrix when similarly augmented 


becomes 


. 2. = 
a. @ & ; (14) 
—4 a2 4 











which is also of rank 3, as can be seen by evaluating its determinant. 
It is trivial to notice it here, but it will be important later, that if 
the bordering row be regarded as itself a matrix 


{2 1 1] 


it has a rank of 1, so that its rank, plus the rank of the original ma- 

trix, gives the number of columns in the original, and thus the num- 

ber of unknown parameters. This will be the case in general. 
Furthermore, the coordinates of the bordering matrix: 


(2 1 1] 


supply the coefficients for the restriction equation necessary to solve 

the derivative equations for the Q’s in determining F. 9 this ex- 

ample, the restriction equation will be 1- 6, + 1-f,=0,or > £.=0, 
8=1 

or in the analogous expression written for the sample, 


> B,=0. | (15) 


8=1 


So far; then, we see that the rank N of the sample space is given 
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by the number 7, + 7, of rows in the original matrix; that the rank of 
the estimation space is the rank 2 of the original matrix; and the rank 
of the error space is N —2=n, +” — 2, or the rank of the sample 
space minus the rank of the estimation space, or the number of rows 
in the original matrix minus its rank. 


Q will be 
Dst (Xs ae A sui B,)*. 


When this is differentiated, first with respect to A , then with respect 
to B,, and finally with respect to B., we will get three derivative 
equations 
—2 palta— A — B,) =0 
—235:(X1:—-A—B,) =0 (16) 
wn Zt Aer — A— B,) =0, 
of which the last two add up to the first, so that we do not have three 
independent equations and cannot solve them for the three unknowns 
A,B,, and B,. But the bordering vector on the original matrix in- 
dicated what restriction equation, when added to these three, will en- 
able a solution. Introducing it with the appropriate Lagrange multi- 
plier leads to the values of A , B,, and B., as usually obtained: 


A=— Di Xe=Tz.. 


=X,.-—X.. (17) 
1 
B,=— >: X2—A 
Ne 
=X,. —X 


With these values we determine Q,, and since we already know 
that f. = N —2, it remains to explore Q, and f,. These depend upon 
the hypothesis to be tested, of course. Commonly it is 8, =0,s=1, 
2, or, in English, the group effect is nil, or that the group factors £, 
are of no importance in the population sampled. This hypothesis is 
equivalent to the proposal that the model for the population be simply 


E (Xt) — as 


in which case the table of expectations is 
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E (X11) ae 
E(X,.) =a 
E(Xi3) =a 
E (Xin) — 7 
E(Xx) =a ete 
E (X22) =a 
E (X23) =a 
Pika =. | 
These have the same form as in set number (2), and the matrix will 
be i 
1 
1 
1 
1 (19) 
1 | 
1 
1 
EP 














which resembles the matrix at number (3). For this simple model 
the estimation space is of rank 1, leaving N — 1 for the rank of the 
error space and the number of degrees of freedom for error. From 
the difference relationship between ranks of error spaces for the two 
models, we see that the numerator of the F test of the ——— 





8, = 0 will be 
Q-— Qu _ Q,—Q. 
fe—fa (N—1)—(N—2) 
(20) 
_Q— Qa 





1 
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The usual way of arriving at the 1 in the denominator of this is 
to observe that there is only one independent statement in the hy- 
pothesis 


(A=0, 
| f.2=0, 


because we have imposed the restriction that 
B,+B.=0. 


But bright students are inclined to ask why the restrictions imposed 
on the B’s for the sample is carried over to the f’s for the population. 
The cleanest way to present the matter seems to be to show the whole 
set of relationships in the model for the population. This is what the 
matrix representation does. 

The usual way to explain the N — 2 degrees of freedom for er- 
ror for Q, is to remark that we have computed two group means and 
have therefore “lost two degrees of freedom,” whatever that means. 
Bright students are inclined to remark that we also computed a grand 
mean A, making three means altogether and not just two. Most of 
the better students seem to prefer the explanation that there are only 
two independent parameters to be estimated, as the rank of the ma- 
trix shows, and it is a matter of no importance whether we say they 
are a and f, or a and #, or f, and f#,, since the rank of the estima- 
tion space is just 2 for the three parameters. 

The next more elaborate model would seem to be 


E(Xs) =at+pet+. 


This would be appropriate to an experiment where s — 1, 2, 3, 
say for three observations made on each member of a group of sub- 
jects, and t=1,2,3,---,%”, for the number of the individual in the 
group. For this one last time we will spell out the expectancies. 
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E(X3:) =at pity 
E (Xi) =a+t p; + Ye 
E (X13) =at Bi + ys 


E (Xin) =at Bb, "Yn 


E (Xe) =a + f+ 9: 
E (Xe2) —a + Bo + V2 
E (X23) —a + B, + Y3 


E' (Xen) =a t+ Bot yn 


E (X31) =at pst y. 
E' (Xs) =a + Bs + yo 
E (X33) =a + Bs + ys 


E (Xsn) — io + Bs + Yn 





(21) 
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The matrix of coefficients from the right-hand side will be 


s t a BB: Bo Bs v1 Yo Ys *** Yn 
ee | 1:20 60 10 0... @ 
ee oOo OF Ff O es @ 
1 73 ar Po C6 Or «= @ 
| a? tf 0 0 0 0 0 1 
2 ro fF O80 Tr 0 6 0 
2 2 LO Lb OC .1 @ 0 
2 eke i 0 (22) 
2 nn ro tf °Oo 0 0 8 1 
8 1 10011 @ @ 0 
3 2 ro oO I @ fF 6 0 
3 3 1003100 421 0 
38 Nn oO @ FF 6 8 © ss J 














It is apparent that the three columns headed by f’s add up to the 
a column, and also the n columns headed by y’s add up to the a col- 
umn. Then we may notice that the n columns headed by the y’s add 
up to the same as the three columns headed by the f’s. If all the re- 
lationships we can note be put in the form of a bordering matrix at 
the bottom, the border will be this: 


a Bi Bo Bs Y¥1 Ya Pa °°° Yn 
—1 1 1 1006 .-- 0 
—1 0 0 e =.) 3 1 (23) 

i | 


S~—— —4§ ——§ 3 1 I 


It is apparent that if we change the sign of the first row of this 
and add it to the second, we get the third. Therefore this bordering 
matrix is of rank 2, and there are two dependencies among the n + 4 
parameters. Thus the number of independent parameters is 2 less 
than n + 4, and is equal ton + 2. Or to put it another way, the rank 
of the original matrix is 2 less than the number of columns, or equal 
to n + 2, which is the rank of the estimation space, leaving 
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N— (n+2) =N—n—2 


as the rank of the error space, or the number of degrees of freedom 
for error. 

The bordering matrix (23) tells what restriction equations to 
use, as well as how many. Its rank being 2 indicates the need for 
two restriction equations, and they can be written by reference to the 
first two rows of the matrix: 
>B.=—0, 


8=1 


b A C; =0. 
t=1 
If the student is interested in writing from the augmented ma- 
trix a determinant of rank n + 4, he may copy the first n rows, the 
(n+1)th and the (2n+1)th rows, and the first two rows of the bor- 
dering matrix. He will find that the (n+4)th-order determinant so 


constructed does not vanish. 
If in this experiment we are interested in whether the observa- 


tions distinguish reliably between the n individuals, we test the null 
hypothesis 


ye =—0,=1,2,38,---,n. 
That is, we propose that the model 
E (Xs) =a + Bs 


is appropriate for the population from which the sample is drawn. 
We have already seen that in the case of such a model with s = 1, 2, 
3, the matrix of parameters will have four columns and a rank of 3, 
leaving N — 3 for the rank of the error space. The F test will then be 

















Q,—Q, Q,— Qa 
ies ee a eee n—1 (24) 
Qu Qu 
(N —n—2) N—n-2 


If we, wish to test whether there are significant differences be- 
tween the three sets of observations, we will test the null hypothesis 


8,=0,s—1,2,38. 


This is, equivalent to proposing the model 
E (Xs) =a t+ Yt. 
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The matrix for this model would be as shown in expression (25), in 
which there are 3n = N rows and n + 1 columns, and where the last 
m columns add up to the first column, so that the rank is 7, leaving 
N —7n for the rank of the error space. Thus the Q, would 





s t a Yi Yo Ys *** Yn 
1 1 i 26 @ «. @ 
1 2 s@ i 0 « © 
1 3 ee t «ae 
1 7 100 0 1 
s 2 ri 8 © 0 
$ 3 ee? 0 
3 3 re 0 i 0 
(25) 
2m 100 0 1 
8 1 i a 0 
$ 2 1010 0 
$ 8 1001 0 
3 Nn 1000... 1 











have N — n degrees of freedom associated with it, and the F' test 
would be 











Q-— Qu. Q-— Qa 
(N —n) — (N—n—2) 2 
= : 26 
Qu — 
(N —n—2) N—n—2 


It is now clear that in the rather numerous class of problems in 
which the null hypothesis has some parameter equal to 0 , the number 
of degrees of freedom for the numerator of the F' test is the number 
of degrees of freedom for error under the simpler model, diminished 
by the number of degrees of freedom for error under the more elab- 
orate model. 

It is interesting to see the clarifying effect of the matrix repre- 
sentation in the case where an interaction term is involved. Suppose 
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each of two observers watch each of three pilots make a landing in 
each of four airplanes, and the interest is in whether there is a link- 
age between observer and pilot. We let 


E (Xetu) =a +t p,'+ vt + Ou't Est » 


where 
s=1,2, for observers , 
t=1,2,3, for pilots, (27) 
u—1,2,3,4, for airplanes, 

and é 


N=, 1% Ny = 24. 


The matrix of coefficients of the unknowns in the expectation 
equations will be as in expression (28), in which I have left out the 
zeros because they are so tedious to fill in. There are 24 rows in the 
main matrix, and 16 columns for the 16 parameters. To determine 
the rank of the matrix, we write the border matrix below. As usual, 
the first row of the border matrix signifies that the first column is 
the sum of the following two. There are 9 rows in the bordering ma- 
trix and it is perhaps not obvious that its rank is only 7, so we bor- 
der the border matrix with a still smaller one at its right, showing 
relationships among the rows of the bordering matrix. This second 
bordering matrix has a rank of 2, showing that there are two de- 
pendencies among the 9 rows of the first border matrix. Its rank is 
therefore 9 — 2=7, and this shows there are 7 dependencies among 
the 16 columns of the original matrix, leaving it with a rank of 9. 
The 24 rows minus the 9 of the rank leaves 15 degrees of freedom for 
error, or a rank of 15 for the error space; 9 for the estimation space. 
So now we have f. = 15. 
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Next we introduce the hypothesis that 
és —0,8=1,2;t=—1,2,38. 


The model for this hypothesis is the same as number (28) except that 
the last 6 columns are dropped off. Also the lower 6 rows of the bor- 
dering matrix are dropped. This leaves the original matrix with 24 
rows as before but with only 10 columns, and leaves the bordering 
matrix with 3 rows and a rank of 3. Hence the rank of the 10-column 
matrix is 10 —3=7,and 24 — 7=— 17 is the rank of the error space 
and the number of degrees of freedom for error. Then the F test will 
be 











Q, ‘i Q. Q, oe Q. 
17—15 2 
= 29 
ar (29) 
15 15 


Thus there are only 2 degrees of freedom for the numerator, de- 
spite the fact that the hypothesis seemed to involve the values of 6 e’s. 

It will be noted that only the very simplest theorems concerning 
the rank of a matrix are necessary for the utilization of the method, 
and by means of the method the student can rather easily compile 
specifications for a variety of experimental models. The relatively 
complete glossary which follows for cases extending through four 
subscripts was prepared by the students in one of my classes. 

For the models to which these analyses refer, the numbers of de- 
grees of freedom in the numerator and in the denominator of the F 
test are given at once. The expression in the right-hand column gives 
the number of degrees of freedom for the denominator. For any hy- 
pothesis involving setting any parameters equal to 0, the simpler 
model without these parameters is consulted, and its number of de- 
grees of freedom for error is subtracted from the denominator num- 
ber to get the number of degrees of freedom for the numerator. 

It is interesting to note how the method shows that we may some- 
times investigate parameters in number greater than the number of 
observations. Consider, for example, the following case: 


E'(Xetu) =at B+ 7: + 6, + Gee + Con + Meus 


s=1,2,8, 
¢=1,2,3, (30) 
“a=1,2,3, 


N=n, 1%; Ny, = 27. 


The parameters are 











PHILLIP JUSTIN RULON 275 


a ? 

B: Be Bs , 

1 Y2 V3 5 

6, 62 bs, 

€11 E12 €13 €21 E22 E23 €31 E32 €33 , 
Cn C12 Cis Cox Coo Cos Csi Cse C33 ’ 
411 12 N13 N21 Neo Nes 431 N32 N33 - 

That is, there are 1 +3+3+3+6+6+6 = 28 parameters, 
and only 27 observations. However, as the last line of the glossary 
shows, the analysis will come out with 3-3-3—3-3—3-3—3-3 + 
3+ 3+ 3—1= 8 degrees of freedom for error for Q.. Among 
the 28 parameters there are only 19 independencies, leaving 27 — 19 = 
8 degrees of freedom for error. 

It is also interesting to see how the matrix representation clears 
up the case of the alternate wording of the hypothesis to be tested. 
Suppose we look again at equation (21) and instead of proposing that 
the f#’s are of no importance in the population, test the hypothesis 
that they have values not 0, but all three alike. Not knowing what 
single value all of them take, we may refer to it as 8 without sub- 
script. Then the coefficients spelled out in (22) become 


a ¢ a B yy. Ye Ys *** Ya 
t 3 % 2 2 

i¢ ae 1 

:.% : 3 1 

1 n i kt 1 
= i » 3 2 

$ 2 ae 1 

2 3 7. ¥ > ere (31) 
2n 1 1 1 
3 1 . 2. - 

3 2 ae 1 

$ 8 a 1 

3 on ae 1 
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There are 3n rows in this matrix and n + 2 columns. The last n 
columns add up to the first, and also to the second, and the rank of 
the matrix is therefore n. This is precisely the same rank as matrix 
(22) would have if the f’s columns were filled with zeros or deleted. 
Therefore the two models are equivalent and the hypothesis that the 
three §’s have some unknown value not necessarily 0 is exactly equiva- 
lent to the hypothesis that they all have the value 0 in the population, 
or that they do not appear. 

If the student or experimenter accidentally posits two identi- 
cally effective parameters, the matrix representation takes care of 
the case automatically. Suppose the student inadvertently proposes 


E(Xs) =atptry.t+ 6, 


in which both the « and # are general factors. The matrix will turn 
out to have the same rank as though the £ had not been proposed, and 
a had been the only general factor posited. 

The representation of the model for the analysis of covariance 
is best handled in the raw-score form. Students who have been 
brought up on the Pearson-Kelley deviation-score approach to corre- 
lation may be a little disoriented at first, but the relation between the 
two approaches is fairly easily shown. Considering only the two-di- 
mensional case, we have in Figure 1 an isofrequency contour and the 


: 





\ 


A 


X74 











. x 


FIGURE 1 


regression line of Y upon X. Y and X are both measured from 0 and 
the intercept of the regression line upon the axis of Y is labeled a. 
Ifs=—1,2,3,---, N for the number of individual pairs of meas- 
ures, then the hypothesis of linear regression of Y upon X is clearly 
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E(Y,) =a+ £X,, 


where £ is the slope of the regression line. Thus # has the same sig- 
nificance as in the deviation-score system, but X is not measured as 


a deviation from X. For those who prefer to think in the deviation- 
score system, a can be expressed as 


a= Y.— px. 


The matrix of coefficients of the parameters a and f takes the 
form 


8 a £ 
i 1 X 
2 1 X, 
3 1 X; 
, (32) 
N 1 Xy 














Since the raw X scores are real quantities not all equal, the rank 
of the matrix is 2 and the rank of the error space—and hence the 
number of degrees of freedom for error—is N — 2. 

Incidentally, if some naive person essays to compute a regression 
problem in which the X’s are all equal, the matrix will tell him that 
he has a trivial case, so far as regression goes. The rank will be unity 
and the number of degrees of fredom for error will be N — 1, not 
N—2. 

The extension to cases of more than two variables is fairly im- 
mediate. 

I realize I have not covered all of the important models for the 
analysis of variance, and have really only hinted at the method for 
covariance, but I hope I have shown enough to demonstrate that no 
advanced theorems in matrix algebra are required, and that the eval- 
uation of the results is in all cases sufficiently clear for practical pur- 
poses, not only in teaching, but in the setting up of new designs, or 
answering those.nasty questions which the naive person has a way 
of asking and which rea!ly require a basic examination of the system 
for a proper reply. 

I should be glad to have any of you spell out other problems and 
let me have the diagrams for my own teaching, as well as for my own 
edification. 
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GLOSSARY 
Model n.d.f. Error 
E(X,) =a m,—1 
E(X,;) =a n,n, —1 
E(X,4,) =4 nnn, —1 hs 





E(X,;) =a-+A, 
E(X,,) =a+ 7; 
E(X54.,) =a:t+ B, 
E(X,14) =at+ 7, 
E (X44) =a+ 8, 


NN, — Ng 
NN, — 7, 
NNN, — Ny 
NNN, — Ny 
N,N,N, — Ny 





E(X,,) =a+8,+ 7; 
E(Xg14) — & + B, 9 Yt 

E (X44) ie +8, + 5, 
E(Xgty) =at+; +8, 

E (X41) —a +B, +7,+ é, 


NN,—N,—n, +1 

N,N,N, —N,—N, +1 
NNN, —N,—Ny, +1 
N,N,N, —N,—N, +1 
N,N,N, —N,—N,—MN, + 2 





E(X54y) =a+ est 

E (X44) =a+ 8B, + &¢ 

E(X 541) =a + Ve + gs 
E(X,;.) =a-+ B, =f + Pr 


N,N Ny, — NgNy 
NN Ny — Ngity 
NNN, — N,Ny 
NNN, — N,N; 





E (X54) =a + B, + ety 

E(X,24) =a + B, + Vz + ogy 

E (X44) =a+ Bg + Y: + ety 
E(X,,;,,) =a+ Yt ae 5, : est 
E(X,14) a+p,+7; + ‘+ eee 


N,N,N, —N,— nN, +1 
N,N,N, —N,—N,N, +1 
N,N,N, —N,—NN, +1 
N,N,N, — Ny, — NN, +1 
N,N,N, — 2, — N,N; +1 





E (X41) =a-+ Bit ¥y+ eeu + Sty 
E(X444) —-a + B, Je $y i est + Stu 


N,N,N, — NN, — N,N, +1 
N,N,N, — NN, — N,N, + 1 





E(X41,) =a+ Bs + Yt + est > Stu 
E(Xe4y) = a+ By + Vz + ese + Sou 
E(X,:,,) =a+ Bit Yet 5, + &g¢ + Seu 
E(X44.) =a-+ Bs 2 $y, + ou +ty 
E(Xy14) —=a + Bs + Vt 

- 5, - est + Sou + "ty 
E(X.4,) =a+ B, + 5, + est 

+ ons + New 
E(X,:,) =a+ Yt + 5, 1 est 

I+ Sou + Tee 
E(X,:,) =a-+B, + Yt - 8, + est 
+ Sou + Ney 





NNN, — NN, — NN, > Ne 
N,N,N, — NN, — NN, as Ng 
N,N,N, — NN, — NN, If nN, 
N,N,N, — NN, — NN, 2 Ny 
NNN, — NN; — NN, — N,N, > N, + ny 


1,0 ,N, — N,N, — NN, — NN, + nN, +n, 
NNN, — N,N, — NN, — NN, + ny + Ny 


N,N,N, — N,N, — N,N, — N,N, 


+n, +n,'+2,—1 
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r, AND OTHER COEFFICIENTS OF PATTERN SIMILARITY 


RAYMOND B. CATTELL 
UNIVERSITY OF ILLINOIS 


A pattern consists of fundaments and relations. Its similarity 
to other patterns can be expressed either in terms of relations alone 
—in which case a modified correlation coefficient, 7, , suffices—or in 
terms of fundaments and relations, where new coefficients, 7, and ", 
are required. The derivation of a coefficient of pattern similarity, 
Y,, is presented and its properties are investigated, both deductively 
and in terms of actual data on culture patterns. 


1. The Need for Mathematical Treatment of Configurations 


Situations wherein psychologists are called upon to express pre- 
cisely the goodness of match of two patterns (as when, for example, 
one of them is a criterion) have lately multiplied. However, tech- 
niques for formulating patterns or profiles and for determining the 
“degree of like-mindedness” (14) have rarely been discussed. One of 
the earliest explicit discussions appeared a decade ago in Zubin’s (14) 
analysis of patterns in questionnaire responses. The notion of “de- 
gree of similarity of personality pattern” is also central in Burt’s 
(1) and Stephenson’s (11) development of Q-technique. Such aspects 
of these and other contributions as refer to the specific question of 
measuring profile resemblances will be discussed in the present ar- 
ticle, which aims at a systematic discussion of issues in pattern match- 
ing and the development of suitable indices. 

That psychologists should study the meaning and effects of the 
total personality configuration rather than of mere levels in specific 
variables has been repeatedly urged in both theoretical and applied 
psychology. Vocational guidance psychometrists, for example, speak 
of fitting the individual profile to that of the occupation as a lock- 
smith fits the wards of a lock and key. Educational selection has 
come to think of its tasks more in terms of “types” than in terms of 
“levels” of scholastic institution. Classification of occupational inter- 
est profiles and other categorizing of patterns has also called for meth- 
ods of estimating similarity exactly. In theoretical and philosophical 
realms countless pages have testified to the importance of the one and 
indivisible total configuration, although the vagueness of Gestalt psy- 
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chology was unable to produce any precise techniques for extracting 
the meaning or effects of those “shapes,” in which every psychologist 
had long been interested. 

On the other hand, some techniques, such as Vernon’s matching 
method (13), specifically deal with effects of configurations, but rele- 
gate the pattern to intuitive assessment rather than to an explicit 
mathematical treatment. 

Finally, there are certain research designs in common use which 
are open to doubts so long as they fail to incorporate suitable pattern 
formulations. For example, in matched groups and stratified sample 
designs it is not enough to equate means and deviations of individual 
variables alone. These may be adequately matched and still leave the 
distribution of patterns unequal. Such a matching procedure is in- 
adequate because matching for certain psychological effects depends 
on particular patterns occurring with specified frequency in the ex- 
perimental groups. For instance, a study has recently been described 
(by the present writer, 3) in which delinquent and non-delinquent 
groups were matched not only for statistics on separate variables but 
also on patterns. 

These considerations will remind the reader that patterns have 
been “more honored in the breach than in the observance” of any 
effective technique for measuring them, and justify the present com- 
paratively elementary approach to the topic. The provocation to the 
present siege of the problem has been a research undertaking in 
which “pattern” is peculiarly the essence of the enquiry, namely so- 
cial psychological research on the form of various culture patterns 
(6). Here the issues are appropriately illustrated by the problem of 
obtaining indices of culture pattern similarity among nations, but they 
are quite as important in personality study and other realms of psy- 
chological research, and the present general treatment applies equally 
to these realms. 


2. The Definition and Expression of a Pattern 


A pattern, in its most general form, is a system of measurable 
parts related in a whole. The persistent relations which tie the parts 
into a whole and distinguish it from other wholes, both in fact and 
in human perception, range from simple quantitative and spatial re- 
lations to the mest complex functional, causal, evidential, and psy- 
chological relations. 

Here we shall be concerned primarily, but not entirely, with 
quantitative relations and the effects that arise from them. Such 
a treatment is applicable to problems in every field of psychology, 
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e.g., in perception, in physiological psychology, in personality meas- 
urement, in social psychology, and in studies beyond psychology, e.g., 
economics. Actually as far as the writer has been able to ascertain, 
the sister sciences have not already developed statistical tools to han- 
dle the problem. 

The ground may be cleared of one important source of confusion 
from the outset if we state that the patterns or profiles with which 
we deal will be restricted to those in which the part measurements 
are along independent dimensions. If necessary, the treatment can 
later be extended to correlated components, although in practice it 
might generally be more economical to factorize correlated variables 
and reduce the problem to one involving a minimum number of in- 
dependent common factor measurements. Thus some profiles that ap- 
pear in current psychological work are obviously built from highly 
intercorrelated variables, for example, the sub-test scores in general 
ability tests. This would greatly complicate any weighting of profile 
items, since some dimensions are represented several times over. Let 
us suppose, therefore, that the components of the pattern or profile 
are independent measures, as in the example used below, where some 
72 variables having reference to national syntalities (5), e.g., vital 
and economic indices, population mores, and national historical be- 
havior, have been reduced to twelve dimensions of culture, in terms 
of which any individual national syntality can be expressed.* 

We may further simplify discussion, without really losing any 
breadth of reference, by considering that form of pattern we call a 
profile, as illustrated in Diagram 1 below. Therein, as in any pattern, 
the individual subject is defined by a set of measurements, together 
with a definition of each dimension along which a measurement is 
taken. But a glance at the diagram will remind us that the systems 
of relationships which arise among these “fundaments” (to use Spear- 
man’s basic system of description) may be, up to a point, quite simi- 
lar in two patterns that have different fundaments. For example, if 
height and girth are two “dimensions” of the physical man, a small 
and very muscular man may possess the same ratio as a large fat 
man, though the “fundaments” of this relation are very different. Or, 
to take a less material instance, the same sort of smile may rest on 
very different faces, though it may be carrying the independence of 
shape too far to claim that, like the grin of the Cheshire cat, it can 
exist without any cat behind it at all. 


*It is perhaps unnecessary to point out that this analytical independence of 
dimensions does not gainsay the unity of the pattern which is measured through 
them, for the independence of length, breadth, and depth variation among boxes 
does not contradict their being attributes of a single box. 
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There is, in a word, a duality about every pattern which requires 
that its definition be given at two levels. Equal fundaments imply 
equal relations but equal relations do not define equal fundaments. 
Shape and size (or level, in a profile) must both be fixed. There is a 
hierarchy of internal relations and there are fundaments. Actually 
the complete definition of a pattern requires a third kind of informa- 
tion, namely, that concerning its orientation and position. But these 
external relations are matters we set out to investigate only after we 
have defined the pattern internally and of itself. Our discussion, 
therefore, turns now to the definition of the resemblance of patterns 
with regard to the above duality. 


3. Three Senses of Pattern Matching 


The matching of patterns must be carried out with reference to 
the same duality as enters into their definition. But we must also 
consider certain combinations of these two aspects of a pattern, so 
that matching formulas are not two in number, but comprise three 
major and various minor formulations, as follows: 

1. Matching for Shape. It is largely in perceptual problems 
that shape is paramount and that techniques for expressing the degree 
of resemblance in shape alone are important, but a diligent search 
would doubtless yield examples in many other corners of psychology. 
In personality study the determination of the degree of maintenance 
of a pattern through periods of learning and maturation also calls for 
shape indices, and it has been asserted, though with little theoretical 
or practical support, that the personality profile per sé, i.e., regard- 
less of level, is important in determining certain adjustments and 
effectivenesses of the total personality. 

There seem to be, broadly, two ways of expressing the agreement 
of shapes of profiles, (1) by the correlation coefficient in one of its nu- 
merous forms and (2) by the use of ratios among the various parts. 
We shall not explore the second of these, for it suffers from the serious 
drawback that the number of ratios required to define the pattern 
increases at least as fast as the number of parts. However, this ap- 
proach should be explored at some time, perhaps by using the ratios 
themselves as elements in the r, coefficient developed below. 

Whereas a ratio method appeals when the fundaments are very 
few, the correlation coefficient becomes attractive when they are many. 
Two profiles may correlate perfectly when their shapes are similar, 
even though their levels in all elements are quite different. This holds 
whether one uses the rank formula, the product-moment coefficient 
on raw scores, or the product-moment coefficient on scores that have 
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first been standardized or scaled in any linear fashion. 

Reference to determination of similarity of shape cannot be made 
without taking sides in the controversy between Burt (1) and Ste 
phenson (11) over Q-technique. So long as the rank correlation co- 
efficient is used, with the further assumption that all individuals have 
the same mean level in their “significance continuum,” no exception 
can be taken to Stephenson’s procedure—except the objection, with 
which we are not concerned here, that solipsistic scales* are of little 
use in psychology. 

If one uses the product-moment formula, as Burt does, or the 
rank formula without the further assumption, it is possible to get per- 
fect correlation between two persons, as indicated above, even when 
their profiles are similar but at very different levels. The factor analy- 
sis of matrices of such correlations is perfectly legitimate, providing 
one bears in mind that the factor corresponding to the first general 
factor in R-technique is missing. This would be a “general size” fac- 
tor. It is missing because the correlation coefficient has made similar 
patterns “identical”? even though they are very different in size. In 
the writer’s opinion the most serious errors occur when students em- 
ploy Stephenson’s notion of finding “types” by Q-technique, but use 
it on behavioral instead of solipsistic data. Instances will be cited 
below, in connection with culture patterns, which show how fallacious 
it is to say that two individuals belong to the same “type” because 
they have a similar shape, when their levels are decidedly different. 

For certain limited purposes, however, an expression of the simi- 
larity of shape alone is desirable. The index for this purpose we shall 
call the “shape correlation coefficient,” and denote it by 7, to indicate 
that it differs from the ordinary correlation coefficient in that the 
scores have first been “standardized” in a special way. The two val- 
ues, in each pair of corresponding scores in the correlation series, 
have, in fact, first to be normalized with respect to the population of 
scores in that particular category. Without such a correction greater 
weight would be given, in general, to the disagreement of profiles with 
respect to variables of larger dispersion. It can be argued that this 
procedure uncorrected incidentally increases the influence of chance 
errors. The “shape correlation coefficient,’ as an index of pattern 
similarity, may therefore be written: 

wr 
aa, (1) 


Nioz’ Oy’ 





Ys 


in which n is the number of elements (variables) in the profile, and 2’ 


*Defining solipsistic scales in the sense of scales dependent solely on intro- 
spection (4, p. 151). 
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and y’ are the corresponding values of the two patterns in each ele- 
ment. These values of x’ and y’ are shown as primes because, as ex- 
plained above, they have first been standardized with respect to the 
distribution within each separate category (element or dimension) of 


the profile. 
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Similarity of Two Culture Patterns with Respect to Twelve Dimensions. 


2. Matching of Patterns for Absolute Agreement. The common- 
est of all matching problems, in which there is no reason to believe 
that one variable is more important than another and in which there 
is no evidence that shape alone, in abstraction from level, is the essen- 
tial aspect, requires another index. We now require the extent of 
agreement of a pattern A with a pattern B, as in Figure 1, in terms 
of some over-all index of the deviations of the two patterns with re- 
spect to each of the elements in each category. Chi-square may sug- 
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gest itself but is actually not suitable because it gives only a measure 
of departure of agreement from chance, whereas we seek a statistic 
that is quantitatively more similar to the correlation coefficient. True, 
the latter difficulty could be overcome by a modification of chi-square, 
such as the coefficient of contingency or Guilford’s phi, but this does 
not parallel the normal positive and negative distribution of 7, or 7, 
and this anomaly, combined with the first difficulty, decides us to re- 
ject chi-square and its immediate derivatives. 

If we desire an index with properties similar to those of the corre- 
lation coefficient, a new statistic has to be developed. And similarity 
to the correlation coefficient is desirable, since one of the uses of the 
new index may be to permit a search for correlation clusters or fac- 
tors. In any case, and especially in the applied field, it is convenient 
to use an index having properties to which psychologists are accus- 
tomed. 

The new pattern similarity index, which we shall call 7,, must 
operate upon data which have first been converted to standard scores 
with respect to each element or dimension of the pattern, as above, 
in order to give equal weight to each of the variables. It should then 
operate on the individual difference of the two patterns with respect 
to each and every category, and express the result in terms of some 
distribution expected from chance alone. 

The development of such a coefficient will be described in sec- 
tion 4. 


3. Matching of Patterns for Effect. First it is necessary to 
broaden the horizon of our enquiry, and ask what purpose we imagine 
ourselves to be pursuing in matching patterns in either of the above 
senses. The simplest answer usually is that we are matching for 
effect, i.e., that we are interested in some functional equivalence which 
the similarity confers. For example, that man is selected as teacher 
whose profile most closely approaches the profile of other successful 
teachers. It is assumed that then he too will probably make a good 
teacher. 

If this is actually the objective, and no different or more remote 
consequence of pattern similarity is in question, a relatively specific 
answer to our problem exists. Here, if computation has already found 
the regression of the various independent factors in the pattern upon 
measured success in the criterion performance, we may use the ordi- 
nary factorial specification equation, as follows: 


Pi3 = 8k’ ui + 8j2F 4 + +++ + SjnF ni + 8jF ji, (2) 


where P is the performance effect of an individual 7 in the situation 
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j, the F’s are his source trait (factor) strengths, and the S’s are the 
situational indices (factor loadings) of these traits in the situation 7. 

Matching patterns for effect, in this way, introduces two con- 
ceptions not involved in 7, and 7,: (a) Interaction of parts enters, 
in that, if the factors are not orthogonal, the specification equation 
can employ terms expressing interaction of factors. (b) The direc- 
tion of the difference of endowment in the fundaments becomes im- 
portant, because, as long as linear relations hold, increasing (or de- 
creasing) endowment in any one factor contributes indefinitely to 
increasing performance or effect, i.e., there is no optimum level in 
each. 

The most general expression of the above is, of course, the ordi- 
nary multiple regression equation, evaluated by the determination of 
multiple correlation. Competent statisticians have frequently asked 
clinicians engaged in pattern worship why they do not use this device 
for matching or expressing patterns. It is probable that the psychia- 
trist’s failure to do so is not merely due to lack of familiarity with 
statistics, but arises from an intuition that this does not give the an- 
swer wanted. When we measure the approach of a given pattern to 
a criterion pattern we are commonly concerned not with the goodness 
of match for some specific purpose but with the effectiveness with 
which one may be substituted for the other in a wide range of situa- 
tions. It may be, of course, that we can agree on what constitutes a 
typical sample of the universe of situations to be met. In that case 
we can weight the factor loadings in the various specification equa- 
tions to give the best “ali-purpose” values. But even so the objection 
remains, to any coefficient based on the specification equation or mul- 
tiple regression, that it assumes linearity and takes no account of a 
possible optimum level in each of the variables. 

However, if we use this approach in cases where it is suitable, 
there still arises a need to express the goodness of match in some more 
universally meaningful or comparable form than that of the simple 
difference between the “performance” resulting from the individual 
pattern and the “performance” resulting from the criterion pattern 
in question. That is, we want some expression beyond the mere dif- 
ference of standard scores, such as “P;; — P,; ,” if we consider 7 and 
i to be two individuals whose performances are expressed through 
equation 2. This could be done through the use of y?, or some deriva- 
tive of y*, such as r,. Anticipating our subsequent derivation of the 
r, index, we can regard the present coefficient of pattern-effect simi- 
larity, which we will write 7’, , as a special case of r,, namely, that 
in which there is only one element or category. Thus: 
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_ 2k—d 
2k +d?" 


where k is the limiting instance of k as defined in 7, below. 

This will equal unity when the agreement of effects is perfect, zero 
when the agreement is no greater than chance, and will approach —1 
as the disagreement becomes as great as it can be. It will be observed 
that d, the difference of the performances resulting from the two 
patterns, can be analyzed into or obtained from a weighted sum of 
the differences on the separate elements of the pattern, as follows: 


d= Pi; — Puy = 8: (Fi — Fur) + 8j2 (Foi — For) ++ 
+ 8jy(Fxi— Fm) + 8)(Fii— Fun). 


U 


Tp 


(3) 





(4) 


4, The Properties of the r,, r,, and r’, Coefficients 
of Pattern Similarity 


Before anything further can be said about the relations and rela- 
tive utilities of the three coefficients above, 7, , 7, and 7’,, it is neces- 
sary to examine the coefficient, 7, , in some detail. 

Since the variance of the difference of two independent variates 
is equal to the sum of their variances (10), the variance of the dif- 
ference of a population of pairs of values taken at random among 
standard scores will tend to equal 2. Thus, if our two patterns for 


comparison had an infinite number of elements, each in standard score 
2 





form, the two patterns could be said to be unrelated when 


equals unity within chance. But since patterns usually define only a 
“small sample” of elements the chance distribution of Sd? will not 
be a normal distribution with a mean at 2. Fortunately the tables of 
chi-square will give us the distribution of Sd? for any given pattern, 
i.e., any given number of elements, and, as will be seen in a moment, 
it is necessary to use this distribution in determining our index. 

The ratio of the discovered to the expected Sd?, i.e., a treatment 
along the lines of analysis of variance, does not, in itself, provide a 
very useful index. In fact, since most of the situations and processes 
in which the new coefficient is to be used are similar to those relating to 
the correlation coefficient, our ideal, as proposed above, is to transform 
it into a statistic with properties very similar to those of the correla- 
tion coefficient. In the first place, it must meet the three requirements of 
being 1 when the two profiles are perfectly alike (i.e., when Sd? is 
zero), of being 0 when >d? equals the chance expectation of difference, 
and of being —1 when the differences are as great as they can be. Thus, 
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ad? 
Qn’ 
fails to meet these requirements for the correlation ratio varies only 
between 0 and 1. 

Let x be the discovered ratio of the actual to the mean expected 
variance and y be the desired, transformed coefficient. We may now 
write an equation of any degree greater than one satisfying the above 
condition; simplicity of computation suggests that we first try the 
second degree. Thus, we wish to find a second-order curve, which 
cuts the y axis at + 1, the x axis at + 1, and approaches y = —1 as 
an asymptote. The family of conics which satisfies the three given 
conditions is: 





the suggestion of using a form analogous to « or 9, i.e., 1 — 


ay? + ay+a+(1—a)y—1=0 (5) 


where a takes any value (except 1, which gives a degenerate hyper- 
bola). It simply remains to determine a value for a which gives the 
best compromise with respect to the desired characteristics of the 
new coeflicient, notably a suitable distribution and a relatively sim- 
ple form for computation. 
Setting a equal to zero gives the simplest computation form, 
namely, 
_ Ee 


ite (6) 





y 


ie =a? : 
Substituting our value of x, namely x = os’ we obtain as our pro- 
n 


posed pattern similarity coefficient 
2n — Sd? 
2n + Sd?’ 
which for present discussion we will call 7,. (7, is first mentioned 
later, for reasons that will become evident.) As our later analyses 
(Figures 2 and 3) will show, this yields a skewed distribution, which 


has an insufficiency of the higher negative values. 
Cne way of correcting this is to take a higher degree equation, 


such as: 


(7) 








1— 2" (3) 
y= ‘ 
, 1+" 
For example, setting n = 2, we obtain 
1—2? 4n*— (Sd?)? 
= = (9) 


"Lt? an? + (Sa)? 
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which is also illustrated in Figure 2. However, this heaps up high posi- 
tive values at the same time that it increases the number of high nega- 
tive values, an effect further aggravated by still higher values of n. 
Another possibility is to return to equation 4 and take values greater 
than 0 for the constant a. For example, setting a = 3 yields: 


od (382 +1) + VY (8% + 1)? — 24(%—1) 
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Relations of 2d? to the Coefficients r,,, r,.,, and y+ for a 12-Element Profile. 
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which can be graphed more simply using the equivalent form, 


- (2y + 3) (1—y) 
3(y +1) 





(11) 


The graphs “or equations 7, 9, and 10, relating y values to >d? 
values, are shown in Figure 2 (when n = 12) with the help of this 
graph we mzy turn out attention to criteria additional to the three 
requirements stated above (i.e. limits of 1, 0 and —1), through which 
we can decide which is the best possible transformed function. The 
resemblance to 7 should, if possible, extend to having a normal, sym- 
metrical distribution (for large samples) and the proper kurtosis. But 
does this distribution refer to the distribution of sample values when 
the true value of 7 is zero, or to the distribution of some “normal 
sample” of real relationships? The latter is hard to define, for there 
is no recognized “population of relations” from which we could take 
a sample. It would not suffice to require 7, to distribute in the same 
way as r for an identical sample of pattern data, for we have already 
argued that r is defective as an index of pattern similarity. However, 
the only possibility seems to be to compare the distributions of 7, 
with those of 7, for some relations important in general psychologi- 
cal work, such as relations of personality patterns, and, with special 
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FIGURE 3 
Distribution of the Coefficients r,, r,,, and r,,, for an Actual Sample of 136 
Culture Pattern Relations. 
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reference to our practical problem, relations of culture patterns. 

Accordingly, we shall study r, coefficients, (i.e. rp, 7» and 1p") 
both in terms of their distributions of sampling errors and their dis- 
tributions of significant coefficients, although we shall put more 
weight on findings from the former situation. As a first approxima- 
tion to a distribution of real relations we have plotted, in Figure 3, 
the distribution of coefficients of relationship between the patterns of 
17 countries chosen at random, i.e., taken in alphabetical order, from 
the beginning of our complete list.* The distribution of the 136 pos- 
sible relations among these are shown for (a) ordinary r (in rank- 
order form,} but based on scores standardized within each category 
and therefore properly labelled 7,), (b) 7, and (c) 1%. ("is 
dropped as too cumbersome.) It will be seen at once that 7, and r,-- 
lead to a relative deficiency of negative coefficients. 
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FIGURE 4 
Sample Distribution of r and 7, When the True Value is 0 and n is 12. 


We now turn to the more theoretically sound criterion of good 
distribution provided by the distribution of the coefficients when based 
on the known chance distribution of Sid?, and obtain frequency poly- 


*These countries are: Afghanistan, Albania, Arabia, Argentina, Australia, 
Belgium, Bolivia, Brazil, Bulgaria, Canada, Chile, China, Colombia, Costa Rica, 
Cuba, Czechoslovakia—as “chance” and diversified a sample as one could wish. 
As far as one can see this list, though random, is also representative, for it brings 
in European, Sinic, and other of Toynbee’s (12) culture areas with almost equal 
frequency. 

+Fisher (6) points out that the distribution of correlations in random sam- 
ples around a true r of zero is not normal if the samples are very small, as here; 
but, apart from using 7»—1 in the denominator, it does not seem necessary to go 
into prolonged calculations of the slightly modified distribution for the purposes 
of gross comparison with r, required here. Our expected distribution of simple 
correlations would also be slightly different because we have used the rank order 
rather than the product-moment formula for our data. 
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gons for r, and r, similar to that shown in Figure 4 but more 
skewed. Sd? distributes itself as 27,? and is positively skewed. Hence, 
transforming the percentage points of this distribution by equation 7 
and erecting appropriate areas over the segments of the baseline so 
determined produces a polygon of 7, , which as stated, is still appreci- 
ably positively skewed. If we are to correct this degree of skewness, 
we must use y? equal to zero when the median, rather than the mean, 
of the Sd? distribution is equalled by the obtained Sd’; since all pat- 
terns are likely, in terms of the number of their elements, to constitute 
“small” samples, this is in better accord with general statistical theory 
(9). For 12 cases the 7? median stands at 11.34, not 12, and we obtain 
an expression, which we shall call the final r, , as follows 


2k — Sd? 
= A. al 
° 2k + 3a? 


where i is the median for y? on a sample of size n. The graph of this 
equation is essentially that of r, in Figure 2 except that it cuts the 0 
axis of the r, coefficient a trifle to the left of the point cut by rp, 7°" 
and r,. Its distribution of sampling errors when its true value is 
zero (calculated as described for 7’, above) is the one shown in Fig- 
ure 4. It remains slightly skewed but is clearly superior to the other 
coefficients. The same verdict is reached if we plot the distribution of 
136 real coefficients using the same data as for the other frequency 
polygons of Figure 3. 


(12) 
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FIGURE 5 
Distribution of r, for a Sample of 2278 Culture Pattern Comparisons. 
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As a final practical test of the behavior of this coefficient, r, has 
been computed for a further 2144 relations, i.e., 2380 coefficients in 
all, representing all possible pattern comparisons among 69 nations 
on the same 12-dimensional profile of culture pattern measurements. 
The distribution of these coefficients is shown in Figure 5. There is 
some predominance of positive coefficients, probably due to a real 
tendency of culture patterns to occur in families, but otherwise the 
coefficients manifest a general distribution sufficiently similar to that 
of ordinary correlations to suggest that 7,’s may be considered in 
practical matters to have approximately similar significance. 

Of the coefficients tentatively examined here, namely 7, , 1p’, 1p’ 
and 7, , we have therefore settled on r, as the most suitable for fur- 
ther "se and investigation. 


5. Discussion of Uses and Relations of r,, r’, and 7p 


The relations of r, and r, have been sufficiently considered above 
by the observation that in spite of some formal resemblance of 7, to 
ry (and therefore to r,) the coefficients are quite different in origin 
and in objectives. We can hope that a body of experience will be built 
up in pattern studies to show in what circumstances each is to be 
preferred, for the answer cannot be given by statistical theory alone. 

In the writer’s opinion the coefficient of pattern similarity, 7, , 
is to be preferred for most pattern matching studies, since, unlike 7, , 
it pays regard to agreement of both shape and size, and is not re- 
stricted to the aim of matching for a particular purpose as is the 
coefficient of pattern effect similarity, r’,. In relation to r,, it is 
necessary to explain a little more fully here the objections expressed 
earlier in this article to the use of Q-technique (using correlations on 
standard scores of elements) for discovering “types” of patterns, in 
human beings or in other data. Can two persons be said to be “simi- 
lar” or to “belong to one type’’* because their profiles have similar 
shapes, even though radically different in level? Is a child in school 
whose drawing ability is high, arithmetical skill medium, and de- 
pendence on authority low to be considered and treated the same as 
an adult artist, of indifferent mathematical ability and an unconven- 
tional attitute to public opinion? They have the same “shape,” in 
these three particulars, but operate at such different levels that the 
total meaning is quite different. Or to take a more brutal instance, 
can we put a Mongolian imbecile, on the one hand, and a brilliant 
schizophrenic poet like Hélderlin, on the other, in any sense into the 

*This is not a criticism of Q-technique as a means of arriving at R-technique 


factors (by an indirect and sometimes more convenient route) but only of the use 
of clusters as proofs of the existence of “types.” 
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same type because both have a verbal ability one and a half standard 
deviations higher than their numerical ability? It is noteworthy, 
also, that in the realm of psychopathology shape is not sufficient. An 
individual having all the elements of manic behavior, but in a slighter 
degree, is labelled hyopmanic or normal. 

The falsity of this use of r or 7, to define essential and total simi- 
larity of pattern can be illustrated as readily in social psychology as 
in personality study. Thus, if we take the instances of greatest dis- 
crepancy between r, and 7, values in the 136 relations above, we find 
Belgium and Brazil with an 7, value of —.91 and an r, value of —.02. 
Among the culture patterns of the world it seems likely that one 
could find better opposites than these, and that the r, value, indicating 
they are quite unrelated, is more realistic than the 7, value, indicat- 
ing they are almost exactly opposites. Another case of extreme dif- 
ference was one of opposite sign, where 7, was —.49 and 7, was + .50. 
In this case—Bolivia and Cuba—the historical and geographical roots, 
such as Toynbee (12) takes into account in determining culture fam- 
ilies, would indicate them to be more alike than unlike, and the r, in- 
dex, with its attention to absolute levels in various dimensions, gives a 
true verdict where the correlation coefficient, attending to shape alone, 
is misleading. 

Instances are numerous enough in the perceptual and cognitive 
fields (including cortical physiology) where similarity of shape alone, 
as determined by r or r,, is the only aspect of the pattern needing 
consideration. When we perceive or say that a man has five toes, the 
percept or concept “toe” is defined by relationship of parts regardless 
of size. The only place where such a mere relationship is important in 
personality or group syntality, however, is where this kind of similar- 
ity means that one pattern may become the other, through growth, 
practice or change of mood. We may then predict from a similarity of 
shape a similarity of future performance. But there are relatively 
few other personal or syntal situations where similarity of shape 
connotes any similarity of performance or any possibility of substi- 
tution in equations of prediction. 

If we pass from individual personalities and syntalities to ab- 
stractions therefrom, such as factor patterns and learning curves, r 
or 7. is more frequently useful. Burt (2), Fiske (8), and others 
have used the correlation of loadings of two factors in a series of 
variables as a test of the assumption that they are essentially the same. 
This demand for an invariant shape rather than an invariant abso- 
lute level of loadings is justifiable, because differences of variance of 
the populations with respect to a factor, or even a change in the item 
length of everything in the battery of tests, would change the reli- 
ability coefficients and loadings without necessarily changing the pat- 


tern as a shape. 
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The relation of 7, to 7’, has already been brieflly indicated. 7’, 
gives the degree of similarity of the patterns for a particular purpose, 
and, with this intention, uses a weighted sum of the standard scores 
on the individual elements of the pattern. Although, in a general 
sense, 7, can be regarded as a special case of 7’,;—that in which all 
elements receive a weight of one—this is not precisely true, because 
in 7’, the deviations are not squared, but are counted positive in one 
direction and negative in another, since we have prior knowledge that 
increase in one direction in a certain element brings continuous in- 
crease of performance. Where we do not have such prior knowledge 
and wish to match the patterns, not for some known, particular per- 
formance, but for every possible contingency of comparison, 7, rather 
than 7’, is the coefficient to be used. 

A final possibility to be conceived in the relation of these coef- 
ficients is that certain circumstances might require some hybrid form 
among them. Consideration of the three profiles, A , B, and C in Fig- 
ure 6, shows that although A and B differ equally from C by the 7, 

















FIGURE 6 


index, they differ in shape to quite different degrees, B having ex- 
actly the same shape as C’. Despite the fact that r, depends on shape 
to some extent, it may be that for some purposes it does not do so 
sufficiently. Perhaps, in addition to 7, and r,, a composite index is 
needed, in effect somewhere between these two, in which the relative 
importance of agreement in shape and agreement in absolute level 
can be adjusted, by weighting, to the empirically or deductively estab- 
lished needs of particular situations. 

Other matters naturally arising from the development of coef- 
ficients of pattern similarity, which cannot be pursued in the space 
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of this article, concern the definition of further properties of the co- 
efficients. Notably it is necessary (a) to obtain the formula for the 
standard error* of 7, (and thereby of 7’,) and (b) to obtain a meas- 
ure of skewness of its distribution by dividing a higher powered mo- 
ment by the square of the above standard error (10). In this connec- 
tion we may simply indicate that the formula for the moments about 
the origin appears to be 


k —~z \t yr2/2 e-2/2 4 (13) 
a e Ld ; 
= k+e@ 2/2 TT’ (n/2) 
0 


where & is the constant in equation 11, is the number of degrees of 
freedom (in this case 12), and ¢ is the order of the moment. 

Modification of r, for two discrete classes—say when scores in 
each of the elements are either 0 or +1 instead of continuous—is com- 
paratively simple, since if the 0 and + 1 answers (e.g., yes and no 
responses) occur in every category with a 50/50 frequency any in- 
stance of disagreement represents a difference of two standard score 
units. We obtain 











k D 
2 
~~ D’ (14) 
k+— 
2 


where D is the number of classes that disagree and k is the y? value 
for n categories. Zubin’s (14, 15) expression for the agreement of 
patterns dealt only with dichotomous scores and consisted simply of 
the number of items (dimensions in our terms) for which the scores 
are the same divided by the total number of items. This takes no ac- 
count of the expected frequency of agreements and does not result 
in a coefficient varying between +1 and —1 through 0; however, the 
useful results which he was able to obtain with it augurs well for the 
scope of research which may be opened up by the present more re- 
fined coefficients. 

Other less immediately needed extensions of the 7, coefficient in- 
clude modification to deal with profiles for which the dimensions are 
correlated instead of independent, and modification to deal with de- 
partures from normality among the distributions of the single dimen- 


*The main complication is that the standard error can be a function both of 
nm, the number of dimensions, and also of N, the number in the population sam- 
ple on which the standard scores of the single cimensions are based. 
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sions. Of course, neither of these conditions need cause modification 
when departures from the assumptions are slight. In fact, the pres- 
ent culture pattern data do deal with both slightly correlated factors 
and slightly skewed distributions, but yield a distribution of 7, (Fig- 
ure 5) sufficiently similar to the theoretical one (Figure 4). 

In conclusion, one should bear in mind that the above pattern 
similarity coefficients are instruments for dealing with similarities 
within a single species, or, at most, within a genus. The individuals 
must belong sufficiently to a genus to be measurable along the same 
dimensions. The coefficients will not indicate whether a cabbage is 
more like a king than a looking glass. And, when 7, is in its usual 
form, based on standard scores in a normal population, it operates 
only within a single species, for mixed species would give multimodal 
distributions; the existence of a normal distribution assumed above 
is itself an indication and definition of a single species. It is possible 
to modify 7, to deal with the situatic in which the two patterns are 
taken from different distributions (but the same dimensions) by ex- 
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FIGURE 7 
Nomograph for Computing r, from =d? for Patterns with 2, 6,10, 12 and 14 
Elements. 
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pressing Sid? in relation to the expected value from different sigmas, 
but the meaning of the answer becomes as complex as the expression. 


A graph to facilitate the determination of 7, when the number 


of elements is 6, 10, 12, or 14 is given as Figure 7. The curve for 
n = 2, i.e., when the “pattern” has two dimensions only, is added to 
illustrate the limiting case. 


10. 


a. 


12. 
13. 


14. 
15. 
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A FACTOR ANALYSIS OF THE STANFORD-BINET 
AT FOUR AGE LEVELS 


LYLE V. JONES* 
STANFORD UNIVERSITY 


Standardization scores on the 1937 Revision of the Stanford- 
Binet are analyzed by the Thurstone centroid factor technique. Cor- 
relation matrices at age levels seven, nine, eleven, and thirteen, each 
based on two hundred subjects, are analyzed. The factors after ro- 
tation are interpreted in terms of the items exhibiting high factor 
saturations. In contrast to the findings of McNemar (1942) no evi- 
dence for a general factor in the Stanford-Binet battery is found 
in the present study. Rather, I.Q. variance can be explained in terms 
of psychologically meaningful group factors at the various age lev- 
els. The results indicate a need for cautious interpretation and use of 
single score indices of intelligence such as the Stanford-Binet I.Q. 


Introduction 


McNemar, in 1942, published a report of a factor analysis of the 
1937 Revision of the Stanford-Binet, based upon item intercorrela- 
tions computed from the performance scores of the standardization 
groups (7). Three centroid factors were extracted at each age level 
analyzed, and the sizeable first centroids were interpreted as giving 
evidence for “just one common factor” at each age level and also that 
“the several general factors found at the various levels are identical 
or nearly so” (7, p. 123). While admitting the possibility of isolating 
meaningful factors by means of rotating centroid axes, McNemar 
stated that “these small ‘group factors’ could not contribute sufficient- 
ly to 1.Q. variance to invalidate the comparability of I.Q.’s of the same 
magnitude for individuals of approximately the same life age” (7, p. 
116). In order to have a clearer picture of the meaning of these fac- 
tors, the present writer applies rotational procedures to the centroids 
found by McNemar at age levels 7, 9, 11, and 13. In addition fur- 
ther centroid factors are extracted and included in the rotations at 
these four age levels. 


*This study was accomplished in partial fulfillment of requirements for the 
Master of Science degree at the University of Washington, 1948. The author is 
greatly indebted to Dr. Lloyd G. Humphreys for suggesting the topic and for his 
invaluable guidance throughout the project. He is also appreciative of the co- 
operation of Dr. @uinn McNemar, who generously supplied the initial data and 
has offered helpful advice in the preparation of this paper. 
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Tests Administered; Subjects 

The tetrachoric intercorrelation matrices at ages 7, 9, 11, and 13 
were based on scores of two hundred subjects at each age, one hun- 
dred boys and one hundred girls.* The analyses were planned so as to 
include at least once every item of the Stanford-Binet scale (both 
Form L and Form M) at age levels VI through XIV, and to provide 
overlap of items from one age to adjacent ages in order to facilitate 
comparisons of the factorial composition of a particular item from 
one age to the next. Names and locations of items used at each age 
and per cents passing each item are shown in Tables 1, 4, 7, and 10. 


Sampling Errors of Tetrachorics 

Consideration of the pass-fail dichotomies leads to the general 
statement that the standard error of the zero tetrachorics ranges from 
.101 to .142 (with a few slightly larger values at age 9). Due to the 
size of the sampling errors of the 7’s, the confidence with which fac- 
tor loadings may be viewed is seriously limited. It is not unlikely that 
several reported correlations of .30 or greater may be chance de- 
partures from zero. Such considerations are indicative of the neces- 
sarily tentative character of interpretations and conclusions reached 
in this study. 


Extraction of Factors 

A vital problem arises relative to the determination of the num- 
ber of centroid factors to be extracted from a correlation matrix. 
While it is obvious that the extraction of factors should cease when 
the residual variance approaches a chance level, no general agreement 
has been reached concerning methods for discovering this level. In 
the present study, decisions concerning the significance of successive 
centroid factors were based upon consideration of a) magnitudes of 
the highest centroid loadings, b) the mean square values for the cen- 
troid factor loadings, c) the magnitude of the largest entries in the 
table of residuals relative to those of the largest residual values at 
the preceding stage of analysis, and d) the degree of meaningful 
grouping of items upon the factors after rotation. Rotations were 
guided not only by an aim for simple structure and positive manifold, 
but by considerations of the possible psychological meaning of results. 
Rotations of the centroid factors were accomplished using a modifi- 
cation of Thurstone’s graphical method which was believed to pro- 
vide both greater ease and greater accuracy than does the original 
method (12). Names have been attached to rotated factors simply 


*An exception occurs at age 7 where items L,VII,3; M,VII,1; and M,VII,2 
were included with N’s of 190, 184, and 182. 
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for the purpose of facilitating discussion and consideration of those 
factors. Names were determined by inspection of the factor content 
and wherever applicable correspond with those denoting similar fac- 
tors reported in previous factorial studies. 


Interpretation of Rotated Factors 
Description of rotated orthogenal factors will, in most cases, be 
limited to the defining items with factor weights of .40 or greater. 
Arbitrarily, for purpose of discussion, loadings of .23 or less shall be 
considered negligible. 


Age 13 

Thirty items are included in the analysis at this age. A complete 
list of items and their location on the revised Stanford-Binet is found 
in Table 1; the rotated factor weights appear in Table 3. 


Verbal Factor 

The factor in Column I’, Table 3, is the most influential at this 
age. It accounts, on the average, for 19.4 per cent of the total vari- 
ance and more items have sizeable loadings on it than on any other 
factor. Ten items, one-third of the total number, are negligibly 
weighted with this factor. The factor appears to be defined by the 
following tests: 






































No. Location Name Loading 
11 ly, RIV, i Vocabulary .83 
19 M, XII, 4 Abstract Words | ................ 81 
16 L, XIV, 6 AVSIPACE WOLGE IE q.g.2...ccccc0- .80 
28 M, XIV, 4 Abstract Words III .... 74 
9 Li; wig, 3 Dissected Sentences -62 
24 M, XIII, 4 Abstract Words II 61 
Z L, XII, 3 Response to Pictures II ...... 57 
1 L, XII, 2 Verbal Absurdities IT ...........0...... 56 
4 L, XH, 6 Minkus Completion 52 
23 M, XIII, 2 Memory for Stories er 
13 bh, way, "sS Picture Absurdities III 44 
20 M, XII, 5 Picture Absurdities IT 43 
30 M, XIV, 6 Reconciliation of Opposites 41 





Even a perfunctory inspection of these items suggests an imme- 
diate hypothesis. The verbal character of the abilities involved in all 
of the items is apparent. Only one item which would be expected to 
be included on this factor does not show up. Item 18—M, XII, 3—a 
second Minkus Completion test, has a loading of only .36 on this Ver- 
bal factor. However, the communality of item 18 is very low, only 








3802 PSYCHOMETRIKA 


.33, compared with a communality of .54 for item 4. 


Reasoning I 

The factor loadings of Column II’, Table 3, contribute an average 
of 11.8 per cent of the total item variance. Thirteen of the thirty 
items have loadings of practically zero. Those items with weights 
higher than .40 are: 























No. Location Name Loading 
22 M, XIII, 1 Plan of Search 78 

5 i, man, 2 Plan of Search ................ at 
24 M, XIII, 4 Abstract Words II A9 
29 M, XIV, 5 Ingenuity ......... 49 

6 L, XIII, 2 Memory for Words ss) as 
14 L, XIV, 4 Ingenuity 45 
11 L, XIV, 1. Vocabulary ...... Al 


These defining tests suggest that this is a reasoning factor. For 
convenience it will be designated Reasoning I. The Plan of Search 
items and the Ingenuity items unquestionably pose problems requir- 
ing some sort of reasoning ability for their solution. That three ver- 
bal tests are so strongly represented here is perhaps surprising. It is 
possible that these items reflect, in addition to verbal ability, a cer- 
tain ability to reason. It is also possible that the loadings on these 
verbal items are somewhat inflated. This possibility seems tenable, 
since there is some degree of separation on this factor between one 
Abstract Word test and the other three. While item 24 has a loading 
of .49, similar items 16, 19, and 28 have loadings of .31, .27, and .33, 
respectively. 

It appears likely that the mean square contribution of this factor 
is spuriously high. The isolation of the Plan of Search items suggests 
that a doublet factor is involved, inflating the Plan of Search item 
loadings. 


Reasoning II 

The factor presented in Column III’ of Table 3, while it accounts 
for only 6.4 per cent of the average item variance, will be considered 
next because of its similarity to Reasoning I. Nineteen of the thirty 
items are weighted negligibly with this factor. Appreciable loadings 


are found in: 














No. Location Name Loading 
14 L, XIV, 4 Ingenuity 58 
8 ie, Baal, - 4 Problems of Fact 49 
29 M, XIV, 5 Ingenuity 46 
25 M, XIII, 6 Memory for Sentences 43 
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The purest measure of this factor is item 8, Problems of Fact. A 
graphical plot of rotated factors II’ and III’ shows Reasoning I, de- 
fined by the two Plan of Search items, almost completely orthogonal 
to this factor as defined by Problems of Fact. Thetwo Ingenuity items 
are well out from the origin on both axes. 

The number of items with significant loadings on this factor is 
not sufficient to enable clear definition, but some sort of reasoning 
seems involved. For convenience the factor has been named Reason- 
ing II. Attention should be directed to findings reported by Thur- 
stone (9) and to findings in the Army Air Force Aviation Psychology 
Program Research Reports (6), which indicate that most reasoning 
items analyzed prove to be complex and that it is not unusual to find 
more than one reasoning factor on a single analysis. 


Memory Factor 

Accounting for 8.3% of the average item variance are the load- 
ings in Column IV’, Table 3. Eighteen of the thirty weights may be 
considered near zero. The six items most clearly defining the factor 
are: 














No. Location Name Loading 

3 i, Bae. 4 Repeat 5 Digits Reversed .65 
Z1 M, XII, 6 Repeat 5 Digits Reversed ...... 61 

7 L, xi. $ Paper Cutting I 46 

6 L, 2a, 3 Memory for Words 45 
10 L, AMT, 6 Copying Bead Chain from Memory .............-..------- 44 

4 L, XII, 6 Minkus Completion 42 





Stability of the factor defined by repeating digits items and im- 
mediate memory tests at other ages adds confidence to the decision 
to name this factor Memory. Conspicuously absent from this list are 
Memory for Designs, Memory for Stories, and Memory for Sentences, 
all of which apparently correlated rather low with the relatively pure 
Repeat Digits Reversed items. This separation of memory tests is 
not surprising. Army Air Force research provides evidence for sev- 
eral distinct memory factors (6). There is no reason to assume that 
immediate memory for form or memory for coherent verbal material 
requires the same ability as does memory for a list of disconnected 
digits. 

Of the items listed above, immediate memory ability might logi- 
cally contribute to success on all except 7 and 4, Paper Cutting and 
Minkus Completion. Inspection of the Paper Cutting test, together 
with introspection concerning method for solution, provides little sat- 
isfaction. That sampling error might explain the presence of the 
item on the Memory factor at this age is suggested by the comparison 
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of its '~-ding here with the low weight of the Paper Cutting item on 
the M_ ory factor at Age 9. The role that memory plays in solving 
the Minkus Completion test is also problematic. The lower loading 
of .26 on Minkus Completion, item 18, might lead us to suspect the 
stability of the higher weight, .42, on item 4. Since at Age 11 two 
Minkus Completion tests show more moderate loadings on the Mem- 
ory factor, sampling error seems a plausible explanation for the .42 
loading of item 4 at the present level of the analysis. 


Visualization Factor 

Factor loadings shown in Column V’ at age 13 (Table 3) deter- 
mine 7.8 per cent of the total item variance. Nineteen items, almost 
two-thirds of the total, are relatively free of loadings of this factor, 
while only three items have weights over .40. These three are: 








No. Location Name Loading 
27 M,22v, $s Orientation: Direction I 73 
15 i, AAV, 56 Orientation: Direction I .................... 65 
12 i ney, @ Induction .......... : REO nee a oe .56 





One hesitates before attempting to name a factor defined by so 
few variables; however, the unique character of these items and the 
relatively large amount of variance which the factor contributes to 
the items lend justification to such an attempt. Here again interpre- 
tation is complicated by the probable influence of a doublet factor. 

Just how appropriate the title “Induction” is to item 12 might 
be questioned. The item involves cutting notches in the folded edge 
of a sheet of paper, first after one fold, then after two folds, three 
folds, etc. The subject is required to state a general rule, so that 
knowing the number of folds the number of holes in the unfolded 
sheet can be immediately deduced. Superficially, the test requires 
abstracting a rule from particular instances. However, the subject 
must be able to manipulate a set of visual imagery before such ab- 
straction is possible. 

Introspective analysis of the Orientation: Direction items shows 
that solution of the problems depends upon an ability to visualize one- 
self moving first in one direction (say going north), turning left, 
turning right, then turning left again, in order that his final heading 
may be named. A similar factor was called “Visualization” when 
found in the Army Air Force studies, defined by such tests as Paper 
Folding and Mechanical Principles (6, p. 295).* The name seems a 


*In a re-examination of some of Thurstone’s data, a Visualization factor was 
isolated, defined by Punched Holes, Form Board, and Lozenges items (6, p. 270). 
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good one for factor V’ at age 13. 

Only two items other than those listed above show Visualization 
factor loadings greater than .30. These are the two Ingenuity items, 
each with a loading of .32. These items deal with methods of carry- 
ing an exact amount of water from the river, given two containers 
of size other than the exact number of pints required. Logically, the 
problems depend upon manipulation of visual imagery as well as upon 
reasoning ability. In solving the problem, subjects may actually “act 
out” the operations, pouring imaginary water from one imaginary 
container to the other. 


Spatial Factor 
Factor VI’ has loadings of .23 or less on twenty-one of the thirty 
tests. Loadings greater than .40 occur on: 


No Location Name Loading 
13 lb, ALY, 3 PIGture APSUNGIOIGS TUG sic sc cesacsncccpeaccowscecetveladssosenvee 67 
ay M, XII, i. INCINOLY TOP DGRIONE HED occ ccscacciecnsccsesnwcnoncensveterenavtes .60 
20 M, XII, 5 PICHIEO VA MOULOIICB EL, op ieg ceckcinescnncecsrnsecansacseexdscanasece 58 
10 L, XIII, 6 Copying Bead Chain from Memory ...................---- 46 


This factor accounts for 7.0 per cent of the average item vari- 
ance. It is defined by items with spatial characteristics, and it is dis- 
tinct from factor V’, Visualization. Calling this the Spatial factor, 
let us provisionally describe the ability involved as one of recog- 
nizing spatial relationships intrinsically present in material actually 
perceived by the subject. Inspection of the particular Picture Ab- 
surdities items represented leads to added confidence in this hypoth- 
esis. 


Age 11 

It will be noted that nine items listed in Table 4 are identical to 
items included at year 18. Seven other items bear similarity to but 
are not identical with tests previously analyzed. Fourteen items at 
age 11 appear to be new and different in name and content. While it 
will be of interest to note similar loadings of the same and similar 
items at the two age levels, we cannot expect invariant behavior 
either of factors themselves or of factor loadings on a given item. As 
the composition of the battery is changed, the resultant correlation 
matrix and factor solution is subject to change. Even if the same 
battery of tests had been administered to both age groups, we would 
have no guarantee of complete invariance. Two years in age separate 
the samples, and there is little evidence for assuming that the same 
problems require the same abilities at age 11 as they do at age 13. 
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Since in this case both the test battery and the population of subjects 
have changed, differences in factorial solutions at the two ages should 
not be surprising. 

In Table 6 are reported the rotated factor loadings of the thirty 
items whose intercorrelations have been analyzed at age 11. 


Verbal Factor 

Factor I’, while not a general factor (nine of the items have es- 
sentially zero loadings), reveals high saturations. In fact, an aver- 
age of 25.2 ver cent of the item variance is explained by this factor. 
Since the communalities of the items for four factors average only 
.517, Factor I’ contributes practically one-half of the variance ex- 
plainable in terms of the item intercorrelations. Fourteen items ex- 
hibit loadings greater than .40. These are: 









































No. Location Name Loading 
12 L, XII, 1 Vocabulary .... 91 
8 L, XI, 3 Abstract Words I 86 
28 M, XII, 4 Abstract Words I 83 
16 i, Xai, 5 Abstract Words II .80 
10 L, XI, 5 Problem Sitvations 72 
20 M, X, 3 Verbal Absurdities III .66 
z L, XI, 2 Verbal Absurdities III .64 
2 i 3 Reading and Report 64 
14 i Bal, 3 Response to Pictures 63 
19 _ Be 2 Memory for Stories 63 
13 iL, Kil, 2 Verbal Absurdities II 57 
25 M, XI, 3 Verbal Absurdities II 54 
27 M, XII, 3 Minkus Completion . 54 
7 i,, Xil, 6 Minkus Completion 42 





Comparison of these tests with those defining the Verbal factor 
at age 13 does show striking similarity. Dissected Sentences and Re- 
conciliation of Opposites items appear on the analysis at age 13, but 
not on the age 11 battery. Problem Situations and Reading and Re- 
port are items first encountered at this eleven-year level. Apart from 
these predetermined differences, the only dissimilarity of tests de- 
fining the Verbal factor at age 13 and tests defining the factor under 
present consideration is the appearance of Picture Absurdities at age 
13. Loadings on these items are considerably reduced on the present 
factor. Since the two Picture Absurdities exhibit similar loadings 
within each age level, we may suspect that a change of approach from 
one age to the other is involved in solving the problem. It is possible, 
of course, that the difference is a result of sampling variation. 

Tests of vocabulary and abstract words best define this Verbal 
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factor at both this age and the age previously discussed. The stability 
of the factor tends to clarify its characteristics and accentuate its im- 
portance in determining scores at these ages on the Stanford-Binet. 


Memory Factor 

Loadings of Factor II’, Table 6, account for 11.5 per cent of the 
average item variance. Sixteen of the tests, over half of the total 
number, have no appreciable loadings. Weights over .40 are exhibited 
by the following items: 


























No. Location Name Loading 

5 1 ee. 6 Repeating 6 Digits 73 
22 M; Xx, 6 Repeating 6 Digits .70 
30 M, XII, 6 Repeat 5 Digits Reversed .. 57 
15 i, Ade, 4 Repeat 5 Digits Reversed 54 

9 iy, Se, 4 Memory for Sentences IV AT 
23 M, XI, 1 Finding Reasons .... .46 

3 Ty. Bs 4 Finding Reasons I : 43 
26 M, XII, 1 Memory for Designs II 42 
25 mM, 1, 3 Verbal Absurdities II .40 





This factor seems to be the same as Factor IV’ at age 13, which 
is Memory, best defined by repeating digits items. It is difficult to ex- 
plain the appearance of Finding Reasons tests on this factor of imme- 
diate memory. Both Memory for Designs and Verbal Absurdities 
probably appear here due to unstable correlations. One similar Mem- 
ory for Designs item and three Verbal Absurdities items have load- 
ings near zero. Neither type of item had high Memory factor load- 
ings at age 13. 


Spatial Factor 

Factor III’ accounts for 12.2 per cent of the average item vari- 
ance and has thirteen negligible loadings. Those items defining the 
factor are: 





























No. Location Name Loading 
26 M, XII, if Memory for Designs II ...... -70 
1 i 2 Picture Absurdities II 65 
29 M, XII, 5 Picture Absurdities II 52 
4 i, 3, 5 Word Naming 52 
7 Jay, Aa, 2 Verbal Absurdities III 48 
25 M, XI, 3 Verbal Absurdities II AT 
11 Ey. ay 6 Similarities: 3 Things 7 
6 iL, 2a, 1 OS en 46 
24 M, XI, 2 Copying Bead Chain from Memory..................-..-.. 46 
20 M, X, 2 Verbal Absurdities III 44 
13 L 2, 2 Verbal Absurdities II 41 
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This factor resembles the Spatial factor reported at age 13, de- 
fined primarily by Memory for Designs and Picture Absurdities 
items. Interpretation is complicated in the present instance by the 
high loadings on Verbal Absurdities and Word Naming items. No 
rationale is offered for their inclusion here. It will simply be noted 
that the factor is less distinct, less specifically defined than was the 
Spatial factor at age 13. 


Residual Factor 

Factor IV’, Table 6, accounts for only 2.8 per cent of the average 
item variance having twenty-five item loadings of near zero value 
and no loadings of .40 or greater. No psychological meaning has been 
attributed to this residual factor. Comparison of the mean square 
value for the loadings on this factor (.028) with the mean square of 
centroid Factor IV, Table 5 (.033), suggests that the variation on 
this rotated residual factor is at a chance level. 


Centroid factor V, Table 5, is of such small significance that at- 
tempts to make use of it at the rotational stage of analysis proved to 
be futile. 

It may be seen that no reasoning factor has been discovered at 
age 11. The absence of a group factor, defined by reasoning items, 
is best explained by referring to the lack of reasoning items included 
at this age. While the age 13 battery included Plan of Search, Rea- 
soning, Problems of Fact, and Ingenuity items, none of these appears 
at age 11. At ages 9 and 7 it will be found that Similarities: 2 Things, 
Similarity and Differences, and Comprehension items define a Rea- 
soning factor. Only one item similar to these is present in the age 11 
battery, Similarities: 3 Things. It seems likely, due to the make-up 
of the battery, that reasoning ability at age 11 is reflected by specific 
factors, not by group factors. Appraisal of items administered at 
age 11 shows also an absence of tests such as those which defined the 
Visualization factor at age 13. Due to the more homogeneous test 
battery administered to eleven-year-olds, only three meaningful fac- 
tors are evident. 


Age 9 

A list of the thirty-five items administered to the nine-year-old 
sample is supplied in Table 7. Ten of these thirty-five items were in- 
cluded at the previous age level analyzed. Fourteen of the thirty-five 
have no analogous entries at age 11. Again it is apparent that the 
expected solution will differ from that at ages 11 and 13, due not only 
to a new make-up of tests, but also affected by the lower age of the 
subjects. 
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It was found profitable to use the first five of the six centroid fac- 
tors tabulated in Table 8 in rotations. 


Verbal Factor 


Loadings on Factor I’, Table 9, account for more than fifteen per 
cent of the average item variance. Eight item weights are negligible. 
Those items by which the factor might be defined are: 












































No. Location Name Loading 
21 M, VIII, 4 Naming Days of Week 64 
25 M, IX, 2 Dissected Sentences .... 61 
14 Mos, 3 WEGHOSU CEL IRODIONG: <.accsccsnscencncsncnsencseshcvenesesscteteseses 56 
27 M, Ix, 4 Similarities and Differences 56 
if L, VIII, 2 Memory for Stories 55 
32 M, X, 3 Verbal Absurdities III .......... 51 
33 M, X, 4 Abstract Word I 50 
16 Lee. 5 Word Naming 50 
12 L, x, 1 Vocabulary 49 
10 iL, Ex, 5 Making Change ...... 49 
3 L, Vill, 4 Similarities and Differences 48 
ri | ib, GX, 6 Repeat 4 Digits Reversed 46 
34 M, X, 5 Word Naming: Animals 45 
9 bs EX, 4 Rhymes, New Form eee 43 
22 M, VIII, 5 Problem Situations 43 





This factor differs from any described at previous age levels 
analyzed. While the items listed seem predominantly verbal in na- 
ture, the factor does not closely resemble the Verbal factor found 
previously. Naming Days of the Week is both logically and statisti- 
cally a complex test, shedding little light on the nature of this factor. 
The Word Naming tests resemble measures of Thurstone’s W, or 
Word Fluency factor (9). The sizeable Repeat Digits Reversed item 
loadings are puzzling. A possible explanation is in terms of the sub- 
jects’ understanding of the problem. It may be that the ability re- 
quired for successful completion of Repeat Digits Reversed items is 
somewhat different for younger children than it is for older. At 
younger ages such a task is quite unfamiliar to the child. The chief 
source of error thus becomes not inadequate memory span, but diffi- 
culty in comprehension of directions. If this is so, the items would 
be expected to have high loadings on a factor defined by other tests 
requiring ability to understand verbal terms. A similar finding has 
been reported in a factorial study by Burt and John (3). In an analy- 
sis of items at ages 10 and 12 of the original Stanford-Binet, which 
was administered to British school children, Repeat Digits Reversed 
appeared on a “Comprehension” factor. 
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If this factor is associated with some type of verbal ability, is 
there justification for the moderate loadings of Vocabulary and Ab- 
stract Words items? These items best define the Verbal factor ai 
higher age levels. It has often been suggested that verbal ability 
does change in character with increasing experience and maturity of 
the child. Conventional verbal-type items could plausibly depend 
more upon reasoning ability at younger ages and depend less upon a 
Verbal or Verbal Relations ability as defined at higher age levels. 
Little confidence can be placed in any hypothesis regarding the exact 
nature of this factor until further evidence is available. 


Reasoning Factor 

Factor II’, Table 9, exhibits a mean square loading of .137. Four- 
teen of the items have near zero loadings; the items with weights 
over .40 are: 












































No. Location Name Loading 
20 Mm, Vil, 3 Verbal Absurdities I 74 
18 M, VIII, 1 Or oe | | ae ee er a eee 63 
28 M, IX, 5 Rhymes: Old Form .... 57 
4 L, Vill, 5 Comprehension IV .53 
2 L, vill, 8 Verbal Absurdities I ...... 53 
26 M, IX, 3 Verbal Absurdities 52 
3 L, Vill, 4 Similarities and Differences 52 
19 um, Vis, 2 Similarities: 2 Things 51 
23 M, VIII, 6 Opposite Analogies II cial 49 
30 M, X, 1 Block Counting 48 
15 L, 5, 4 Finding Reasons I AT 
27 M, IX, 4 Similarities and Differences 45 
12 L, &, i Vocabulary 43 
6 L, IX, 2. Paper Cutting I 41 


While exact definition of this factor is elusive, a tenable judg- 
ment as to its nature may be made on the basis of the reasoning con- 
tent of the defining items. Noteworthy is the finding that two rea- 
soning factors at age 13 were sharply defined, whereas a single and 
less distinct reasoning factor is found at the younger age level. 


Memory Factor 

Factor III’ accounts for 9.6 per cent of the item variance at age 
9. Nineteen items, over half of the total number, have negligible 
weights. The seven items with high loadings are: 
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No. Location Name Loading 
17 iy Ky 6 Repeating 6 Digits ....... : .87 
85 M, X, 6 Repeating 6 Digits 74 

3 FE ,. TX, 6 Repeat 4 Digits Reversed 538 

5 L, VIII, 6 Memory for Sentences III AT 
19 M, VIII, 2 Similarities: 2 Things A2 
29 M, IX, 6 REBCAG 4° IBGE REVERE, <s-noscinccs-scnsconscesesncniscccsonen 42 
10 L, IX, 5 Making Change .... ae Al 





The Repeating Digits items have consistently defined a Memory 
factor at the higher age levels. This again proves to be the case at 
age 9. For most nine-year-old children the problem of Making Change 
is one of “comprehending the task and selecting the correct opera- 
tions” (8, p. 253). The simple arithmetic required presents little dif- 
ficulty. Since the question is asked only once by the examiner, imme- 
diate memory or retention is essential to its solution. It is not sur- 
prising that the item appears on this Memory factor. The appear- 
ance of item 19 poses a more difficult problem. Perhaps there is some 
obscure relationship between this Similarities item and memory abil- 
ity. Itis more likely that the item appears because of errors of sam- 


pling. 


Spatial Factor 

Factor IV’, accounting for 8.9 per cent of the average item vari- 
ance, has near-zero loadings on eighteen items (Table 9). High load- 
ings are contributed by: 
































No. Location Name Loading 
8 b, DX, 3 Memory for Designs 56 
24 M, IX, 1 Memory for Designs I 51 
6 by de, 1 Paper Cutting I 51 
if L, IX, 2 Verbal Absurdities II 51 
26 M, IX, 3 Verbal Absurdities II 46 
4 L; Vit, 5 Comprehension IV 43 
ve L, Vua,.. $ Verbal Absurdities I 42 
12 i. & 1 Vocabulary 42 
1 L Vile, 2 ONY), LOE SOTO ous cn sascsécanssesentesesceeccesnecccsusieeeass Al 
22 M, VIII, 5 Problem Situations 40 


While this factor is defined primarily by items requiring spatial 
ability, a number of verbal items do appear as they did on the Spatial 
factor at age 11. Possibly the factor is not purely spatial in nature. 
The precise character of the factor cannot be determined on the basis 
of present findings. 
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Residual Factor 

Factor V’, with twenty-six negligible loadings and no weight as 
high as .40 (only one item loading exceeds .30), has been viewed as 
a residual factor. It exhibits a mean square loading of .031, compared 
with a mean square loading of .032 for the fifth centroid factor 
(Table 8). 


Age 7 

Of the twenty-four items included in the analysis at this young- 
est age level, eleven are identical to items which appear at age 9. 
Table 10 includes a list of all twenty-four items, their positions on the 
Stanford-Binet, and the per cent of subjects passing each item. Cen- 
troid loadings are given in Table 11 and rotated factor loadings ap- 
pear in Table 12. 


Verbal Factor 


The average item variance accounted for by loadings of Factor 
I’, Table 12, is 21.1 per cent. Six of the twenty-four items may be 
considered to have zero loadings. Items with weights of .40 or greater 


are: 





























No. Location Name Loading 
24 M, VIII, 6 Opposite Analogies IT ................ 13 
11 iL, Vili, 6 Comprehension IV 12 
21 M, VIII, 3 Verbal Absurdities I aa 
7 i, Waal, 2 VOCABUIATY ».2:-:50.0000000 65 
16 L, VII, 4 Repeat 3 Digits Reversed 62 
15 L, VII, 3 Picture Absurdities I .. 60 
5 L, VII, 5 Ua SS IOC Gane ae ee eee .55 
8 L, Vil, 2 Memory for Stories .......... 54 
19 Mm, viel, 4 Comprehension UTE 2. c:..:scieccisescesce 53 
17 M, VII, 5 CEST Se C1 TA 2e" Sg Ree eee ee A2 
20 M, VIII, 2 Similarities: 2 Things .... 41 





The items which best define this factor require verbal ability. 
The high loading of Repeat Digits Reversed corresponds with its ap- 
pearance on the Verbal factor at age 9. Its reappearance at this lower 
age level lends support to the rationale offered previously, that the 
ability required at the younger ages is possibly an ability to compre- 
hend the instructions. 


Neither Factor I’ nor Factor II’ reported below can be consid- 
ered a “general factor” since for any factor to be considered “gen- 
eral’ it must exhibit zero loadings on none of the items. It can be 
said that both Verbal and Reasoning factors are relatively influential 
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group factors at age 7, and that they appear to be less distinct—one 
from the other—than they are at age 13. 


Reasoning Factor 
Factor II’, Table 12, accounts for 18.3 per cent of average item 
variance, presents only four zero loadings, and is defined by: 





No. Location Name Loading 

2 L, VII, 2 SSE CGN Lene ae Shc): en a ee eee 84 
10 L, Vil, 4 Similarities and Differences .............2.........:0c--:0000++ -76 
20 M, VIII, 2 SECC ES LEPC E10 | 9 hc cr a vis 
23 M, VIII, 5 MeN SHOU ACIOD ooo ho ce .58 

9 LL, Vir, 8s WOH A IRN ONOIGB) De oc2 5. cc5286 ce occbcen cess csveadsececeteoeecd 53 

1 L, VII, 1 PACUUES DRO OMICS. Doosan sci2-nssacasscocsassscseneensessessess 52 

4 L, Vit, 4 AC PEC OTINO ED UE ox os aces istenecdoscasauttssacececcauseuatetersee 47 

3 i,’ Vix, 3 Copying Diamond .................... 45 
22 M, VIII, 4 Weming;Daye-OL WGK: 25.020. 2020 Al Al 


The nature of these defining items has suggested that this fac- 
tor is allied to an ill-defined reasoning ability. 


Memory Factor 


If Factor I’ and Factor II’ are considered to be interrelated, 
there still remain two relatively independent group factors at this 
age. Factor III’, with fifteen negligible loadings, accounts for 9.4 
per cent of average item variance and is defined by: 








No. Location Name Loading 
12 L, Vil, $6 Memory for Sentences TIE ............-0c..1.c--csececs 73 

6 ib, Val, «6 ASCE mer 2 1 a an ee eae 56 
22 M, VIII, 4 INEEAENPAIEAGB1OL WGK saci ion on sns.nacencendeceenncctne 52 
14 M, VII, 2 WECMOPY TOP SENUENCES: VT cc... ccvccsctccercoretcsesactesaes-s Ad 
17 M, VII, 5 E25 Fs 8) Se 42 

9 iy, Wi, 8 Verbal Absurdities I se ae rie avres rar 40 
16 i, Vail, 4 Repeat 3 Digits Reversed ........ (.386) 


This corresponds with the Memory factor found at the three 
previous age levels. Verbal Absurdities is, surprisingly, present here. 
Item 21, another Verbal Absurdities test, has a loading of only .12. 
It is likely that for another sample at this age, item 9 would not ap- 
pear on the Memory factor. Sentence Building requires the subject 
to construct a meaningful sentence which will include three words 
given by the examiner. Analysis of the common type of errors for 
seven-year-olds on this item should be undertaken. If the forgetting 
of a word were frequent, the appearance of the item on the Memory 
factor would be justified. 
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Number Factor 
Factor IV’, Table 12, accounts for 8.8 per cent of the item vari- 
ance. Eleven items have loadings near zero. The defining items are: 











No. Location Name Loading 
13 M, VII, 1 Giving Number of Fingers. .........................-:00--000 .75 
17 M, VII, 5 Sentence Building 1 oe 
18 M, VII, 6 Counting Taps ...... AT 

4 L, Vil, 4 Comprehension III .............. 44 
22 M, VIII, 4 DIGI PRS Ol WCC anions. co cocscicncsi desc (.39) 
16 M, VII, 4 Repeat 3 Digits Reversed . (.89) 





This factor is not clearly defined. Most of the items with sig- 
nificant factor weights appear at this age level for the first time in 
the analysis. Possibly the factor is indicative of some type of Num- 
ber ability, although Sentence Building and Comprehension could not 
then be expected to exhibit such high loadings. 


Summary and Conclusions 

In the present study factors have been defined by appraising the 
nature of items exhibiting high factor saturations. In a more com- 
prehensive analysis it would be desirable to refer to detailed test rec- 
ords at the various age levels in order to discover the types of errors 
most frequent for each item. The nature of the items could be more 
adequately determined in this manner and factors could be defined 
with a greater degree of confidence. Introspection by the factor ana- 
lyst, a common procedure, is of little aid when the subjects are chil- 
dren. Under ideal conditions items which define factors of question- 
able nature should be included in another analysis, along with select- 
ed tests of known factorial content, and administered to a larger num- 
ber ‘of subjects in order to insure greater sampling stability. 

For convenience, group factors have been presented as they ap- 
pear on orthogonal axes. If an oblique solution were given, it is esti- 
mated (from inspection of angles between best-fitting oblique axes) 
that factor intercorrelations would range from .00 to .50. It should 
not be presumed, then, that group factors, as defined by Stanford- 
Binet items, are completely independent. An over-all view of factors 
reported at each age and the relative influence of each factor is pre- 
sented in Figure 1. 

At age 13, after rotation of the centroids, six meaningful factors 
appear: Verbal, Memory, Visualization, Spatial, and two Reasoning 
factors. Factors at this age level lend themselves to more clear-cut 
interpretation than do factors at any other age level analyzed. 
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Names and Relative Influence of Factors Reported at the Several Age levels. 
*Factors differing in item content from the Verbal and Reasoning factors at ages 11 and 13. 


At age 11, only three meaningful factors are found: Verbal, Spa- 
tial, and Memory. Inspection of the items included in the analysis at 
this age (Table 4) shows an absence of tests similar to those which 
had defined the three additional factors at age 13. 
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At age 9 the Memory factor remains stable, defined by the same 
items or by items similar to those found at ages 11 and 13. A Verbal 
factor appears at this age, characterized by items apparently some- 
what different from items which had defined the verbal factor at the 
higher ages. The Spatial factor is similar to that found at age 11; 
the Reasoning factor differs from either of the two Reasoning factors 
reported at age 13. 

At age 7, the Verbal, Reasoning, and Memory factors are similar 
to those found at age 9. A fourth factor, rather indistinct in nature, 
is found for the first time at age 7. Absence of a Spatial factor at this 
age is not surprising, since items logically dependent upon a subject’s 
spatial ability are not included in the age 7 battery (Table 10). 

The trend of obtained results conforms to the trend expected on 
the basis of an hypothesis of developmental differentiation of mental 
abilities with increasing age (Anastasi, 1; Balinsky, 2; Garrett, 4; 
among others). In the present study, loss of generality with advanc- 
ing age is indicated bv the more distinct and more clearly defined 
group factors at the higher ages. While it might be argued that the 
factorial solution depends upon the items included and does not nec- 
essarily reflect underlying patterns of mental abilities, it neverthe- 
less seems reasonable that the nature of the items selected did de- 
pend upon the mental organization of subjects in the standardization 
groups. Thus we find more homogeneous items at the younger age 
levels, and appropriately less distinct group factors emerge. 

It is of interest to compare results of the present analysis with 
those of similar studies previously reported. A 1939 analysis by 
Wright (11) is of particular interest, since she extracted factors 
from correlations among items on the original Stanford-Binet. She 
administered tests from age levels VII-XIV to 456 ten-year-old sub- 
jects. Wright reported seven rotated factors, one of which was inter- 
preted as general, perhaps a “Maturation factor,” common to all 
items. Other factors were named Reasoning, Number, Spatial, and 
Verbal Relations. Two factors less clearly defined were reported: one, 
a second reasoning factor (named Induction), another for which no 
rationale was offered. Conspicuous was the absence of a Memory 
factor; short-span memory apparently was required for some items, 
but no such factor was found. Repeating Digits and Counting Back- 
wards items defined Wright’s number ability. Repeating Digits items 
consistently defined a Memory factor in the present analysis. 

Wright’s general “Maturation factor” merits closer scrutiny. She 
included in the analysis, in addition to thirty-one test items, the vari- 
able Mental Age. Presumably Mental Age was determined, for each 
subject, by his composite score on the Stanford-Binet. It is clear that 
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this procedure would produce spuriously high correlations between 
Mental Age and those Stanford-Binet items. In effect, the general 
factor is likely to be an artifact of this particular analysis, reflecting 
not Maturation, but rather exhibiting loadings on items directly pro- 
portional to the internal consistency of those items. (Mental Age 
exhibits the highest loading of the factor, with Vocabulary, and other 
items which correlate highly with total score, strongly represented.) 

Another analysis of the original Stanford-Binet has been report- 
ed by Burt and John (3). These investigators analyzed the intercor- 
relations of twelve items (age level X and XII) which had been ad- 
ministered to 483 British school children of chronological ages 10- 
144. They first extracted a general factor, then found group factors 
to be Verbal, Numerical (defined by Repeating Digits items), Spatial, 
Memory, Vocabulary, Comprehension, and an Age factor which ap- 
parently reflects item difficulty. 

In 1941, Balinsky reported a factor analysis of the Wechsler- 
Bellevue intelligence scale, having administered tests to various age 
groups from age nine to age sixty (2). Due to the small number of 
sub-tests in the Wechsler-Bellevue battery and to the restricted num- 
ber of subjects tested, as few as seventy at age nine, the value of his 
results is severely limited. 

One striking difference appears between the results of the pres- 
ent study and those of previous studies. No general factor has been 
found by the present writer. It is not doubted that by other factor 
methods the same data might be shown to produce a general factor. 
In the light of several advantages of the multiple-factor approach it 
was felt advisable to remain within the limits of Thurstone’s centroid 
method and to impose arbitrarily no general factor on the solution. 
McNemar interpreted the first centroid factor (without rotation) in 
terms of a general factor. Wright’s general factor is of questionable 
origin. Burt and John utilized a method whereby a general factor 
was extracted initially, before group factors had been found. Where- 
as the results of the present study do not contradict those of any of 
these previous studies, they do suggest differences in interpretation. 

Guilford (5) has recently written a timely article in defense of 
the group factor approach to test construction. A test designed to 
measure a multi-dimensional variable can most profitably be con- 
structed by combining sub-tests, properly weighted, each being a 
“pure” measure of one dimension of the criterion variable. Certainly 
intelligence is a multi-dimensional construct. Whatever the “under- 
lying nature of intelligence,” the most fruitful manner in which to 
plan a measure of intelligence is probably in terms of its dimensions, 
that is, in terms of group factors which remain relatively invariant 
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from one sample to another. As an aid to future intelligence test con- 
struction, it may prove useful to be able to refer to factorial descrip- 
tions of its existing standards of measurement. 

Conclusions of any factor analysis study are limited by the sub- 
jective aspects of factor analysis methods as well as by sampling in- 
stability of the inter-item correlation coefficients. Results should be 
considered indicative of channels fruitful for future investigation, not 
as decisive evidence for or against a given hypothesis. In the present 
case results of the analysis suggest the following conclusions: 


(1) Items on the Revised Stanford-Binet do not measure a uni- 
tary factor; the relations among the items can be explained 
most efficiently and consistently in terms of group factors, 
each contributing to a subject’s total score, or I.Q. 


(2) The battery of items included at one age level of the Stan- 
ford-Binet is not factorially identical to the batteries of 
items at other age levels. 


(3) Within the age range from 7 to 13, group factors are more 
_ Clearly defined and distinct, one from another, at the high- 
er ages. 


The findings act to emphasize the need for care in the interpreta- 
tion and use of the I.Q. If an I.Q. is a composite score of measures of 
several abilities, direct comparison of I.Q.’s for different individuals 
(or for the same individual at different ages) can be misleading. 
Knowledge that two I.Q. scores are identical is not sufficient evidence 
for assuming qualitative equivalence of the intellective abilities in- 
voived. 
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TABLE 1 
Reference Numbers, Locations on the Stanford-Binet, Names, and Per Cents 
Passing, for Items Administered at Age 13. 































































































Reference Location Per cent 
Number Form, Age, No. Name Passing 

1 L XII 2 _ Verbal Absurdities II 15 

2 8 Response to Pictures II 72 

3 4 Repeat 5 Digits Reversed .... Tt 

4 6 Minkus Completion x i 

5 L iF 1 Plan of Search 60 

6 2 Memory for Words 69 

‘4 8 Paper Cutting I 60 

8 4 Problems of Fact 69 

9 5 Dissected Sentences 66 
10 6 Copying Bead Chain from Memory II ...... 64 

11 L XIV 1 _ Vocabulary 64 
12 2 = Induction 46 

13 8 Picture Absurdities III 62 
14 4 Ingenuity 54 
15 5 Orientation: Direction I 58 
16 6 Abstract Words II 64 

17 M XII 1 #£Memory for Designs II 12 
18 8 Minkus Completion 69 
19 4 Abstract Words I 78 
20 5 ‘Picture Absurdities II 72 
21 6 Repeat 5 Digits Reversed 72 
22 M XIII 1 _ £Pilan of Search 54 
23 2 Memory for Stories II 59 
24 4 Abstract Words II 68 
25 6 Memory for Sentences IV 67 
26 M XIV 1. Ff :soning 48 
27 3 Orientation: Direction I 59 
28 4 Abstract Words III 57 
29 5 Ingenuity 48 
30 6 = Reconciliation Opposites ................0........0.:000 58 
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TABLE 2 
Centroid Factor Loadings, Age 13 

Item No. I II III IV V V1 h2* 
| -705 .198 013 .056 051 129 559 
2 576 273 125 .047 136 194 481 
3 449 —.270 —.351 158 .412 —.260 -660 
4 585 310 —.190 —.225 102 —.069 540 
5 555 —.250 337 375 .098 —.176 665 
6 677 —.185 —.066 .212 .249 —.071 .604 
7 512 —.209 —.129 --.099 .289 295 .503 
8 390 161 —.164 325 —.128 .209 871 
9 .666 «344 —.138 —.225 .096 125 657 
10 465 —.229 —.259 —.295 .266 —.217 538 
11 850 .250 .308 —.065 —.087 —.159 .916 
12 641 —.252 —.025 —.113 —.281 —.108 579 
13 .674 —.246 3845 —.289 .240 125 791 
14 .658 —.286 —.045 .237 —.253 211 682 
15 .662 —.239 —.258 —.070 —.310 —.123 678 
16 827 344 178 .059 —.136 —.054 859 
17 611 —.249 130 —.241 164 .187 572 
18 422 257 —.254 —.117 —.113 .037 336 
19 800 .400 213 .048 136 —.039 .868 
20 -702 —.236 222 —.250 .030 .249 -723 
21 371 144 —.265 823 225 —.295 AT1 
22 533 —.273 357 305 —.110 —.305 684 
23 405 140 089 —.225 —.234 .054 300 
24 838 .082 158 144 —.123 —.082 Pi | 
25 522 —.004 —.171 172 —.128 127 064 
26 501 105 —.121 059 —.072 125 301 
27 617 —.169 —.213 —.370 —.285 —.198 712 
28 857 223 Be iy pA —.052 113 —.075 835 
29 553 —.296 092 .233 —.331 123 581 
30 452 100 119 —.190 094 —.226 324 

dk 
383 .057 .048 045 .040 .030 603 

n 
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TABLE 3 
Rotated Factor Loadings, Age 13 
Item No. f’ II’ IIT’ Iv’ Vy’ VI’ h2* 
1 56 18 38 27 .09 16 56 
2 57 AZ cau 18 —.07 18 48 
3 —.11 34 06 65 .08 .28 64 
4 52 —.07 05 42 20 ALT 54 
5 24 Pu kd 14 kz —.04 at .70 
6 ot 48 .25 45 .07 29 63 
7 11 02 —.10 46 ol. 35 50 
8 24 .09 49 18 .03 —.12 385 
9 62 —.10 .20 35 19 .25 .66 
10 .06 18 —.11 44 32 46 54 
11 .83 41 .06 kT .25 10 .96 
IZ .26 37 18 .08 56 19 59 
13 44 87 .05 .00 12 67 .80 
14 18 45 58 05 82 15 70 
15 17 29 28 .24 65 18 .69 
16 .80 1 28 an ob —.01 .88 
a7 o2 25 18 .05 19 60 .60 
18 36 —.14 19 26 Bo O01 23 
19 81 at 14 02 —.01 Al .86 
20 48 30 .25 —.05 .25 58 -74 
21 et 22 By 2 61 —.03 —.13 50 
22 28 .78 .05 .02 15 .00 69 
23 44 1 .09 —.06 30 .08 30 
24 61 49 PA 22 .25 .08 .80 
25 .28 18 43 21 22 04 36 
26 38 .09 oo .20 LT 07 320 
27 .26 15 .04 19 73 24 72 
28 74 383 12 31 15 .23 84 
29 AT 49 46 —.08 32 .06 59 
30 41 19 —.16 19 17 AT 32 
Dk2 
194 118 064 083 .078 .070 607 
n 
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TABLE 4 
Reference Numbers, Locations on the Stanford-Binet, Names, and Per Cents 
Passing, for Items Administered at Age 11. 































































































Reference Location Per cent 
Number Form, Age, No. Name Passing 
1 1; Xx. 2 Picture Absurdities II 61 
2 8 Reading and Report 67 
3 4 Finding Reasons I 60 
4 5 Word Naming 66 
5 6 Repeating 6 Digits 63 
6 L XI 1 Memory for Designs 43 
cf 2 Verbal Absurdities III 65 
8 3 Abstract Words I 58 
9 4 Memory for Sentences IV 50 
10 5 Problem Situations 65 
11 6 Similarities: 3 Things 59 
12 L XII 1. #£Vocabulary 46 
18 2 Verbal Absurdities IT 56 
14 3 Response to Pictures II 56 
15 4 Repeat 5 Digits Reversed 48 
16 5 Abstract Words II 52 
bef 6 Minkus Completion 52 
18 M X 1 Block Counting 62 
19 2 Memory for Stories I 80 
20 3 Verbal Absurdities III 66 
21 5 Word Naming: Animals iif 
22 6 Repeating 6 Digits 65 
23 ms 1 Finding Reasons ....... 54 
24 2 Copying Bead Chain from Memory ............ 64 
25 3 Verbal Absurdities II 68 
26 M XII 1 Memory for Designs II 60) 
27 3 Minkus Completion 46 
28 4 Abstract Words I 54 
29 5 Picture Absurdities II 53 
80 6 Repeat 5 Digits Reversed 51 
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TABLE 5 
Centroid Factor Loadings, Age 11 
Item No. I II III IV V h2* 
a 428 .100 —.512 159 —.129 A497 
2 643 .157 194 035 —.116 490 
3 -409 —.263 .003 —.138 —.083 262 
4 480 —.168 .296 145 —.345 486 
5 499 —.467 .190 —.264 —.109 585 
6 325 —.045 —.322 Zak .039 .262 
7 .698 342 —.181 074 —.238 .699 
8 .868 .240 195 116 162 .889 
9 579 —.217 .189 043 164 447 
10 .605 353 .183 151 181 580 
11 596 141 —.229 —.264 122 512 
12 .843 .360 292 —.066 .083 937 
13 .675 157 —.101 147 .041 514 
14 .683 .142 .086 132 —.179 544 
15 452 —.A25 .257 192 100 498 
16 -758 .278 225 .066 .210 -751 
a .610 —.113 .062 .070 221 445 
18 .269 .062 —.252 —.105 .218 198 
19 -735 160 pO —.236 —.299 725 
20 723 291 —.114 .167 —.179 .680 
21 A97 —.118 —.008 —.103 —.100 .282 
22 .456 —.397 156 —.395 —.114 .559 
23 554 .045 —.157 —.306 —.107 439 
24 348 —.239 —.205 .186 —.177 3o7 
25 .820 —.116 —.055 112 186 -736 
26 .697 —.210 —.406 —.192 122 -746 
27 .630 119 129 —.256 .079 499 
28 .827 -246 119 .238 .166 843 
29 .619 —.027 —.249 —.054 .210 493 
30 595 —.404 186 .205 —.096 .608 
zk2 
- 381 .060 .049 .033 .028 551 
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TABLE 6 
Rotated Factor Loadings, Age 11 
Item No. ad II’ lr’ IV’ h2* 
1 19 —.09 65 05 A? 
2 .64 2 14 .00 AT 
3 14 43 21 —.08 25 
4 17 21 52 16 37 
5 15 73 10 —.05 57 
6 12 01 46 18 .26 
7 .64 —02 48 —.08 65 
8 86 .28 25 04 86 
9 39 47 14 14 Al 
10 72 01 13 .03 54 
11 38 18 AT — $i 49 
12 91 21 13 —n 16 91 
13 57 10 41 07 51 
14 .63 18 .25 .08 .50 
15 .25 54 04 35 48 
16 .80 17 .16 .00 69 
17 42 35 26 Al 38 
18 11 .03 34 —.14 15 
19 63 32 23 — 27 63 
20 .66 02 44 04 63 
21 .29 85 25 —.05 27 
22 13 -70 09 — 21 .56 
23 32 AG 08 .20 Al 
24 05 19 46 .23 30 
25 54 40 AT 14 .69 
26 .22 42 70 —.14 73 
27 54 32 17 —27 .50 
28 83 13 30 14 82 
29 33 25 52 —.06 45 
30 34 57 17 85 59 
kz 
252 115 122 .028 517 
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TABLE 7 
Reference Numbers, Locations on the Stanford-Binet, Names, and Per Cents 
Passing, for Items Administered at Age 9. 








































































































Reference Location Per cent 
Number Form, Age, No. Name Passing 
1 L VIII 2 #£=Memory for Stories 82 
2 8 Verbal Absurdities I 81 
3 4 Similarities and Differences .......................- 74 
4 5 Comprehension IV 75 
5 6 Memory for Sentences III 74 
6 L Ix 1 Paper Cutting I 64 
i 2 Verbal Absurdities II 48 
8 8 Memory for Designs 50 
9 4 Rhymes, New Form 56 
10 5 Making Change 70 
11 6 Repeat 4 Digits Reversed 61 
12 Lb & 1 Vocabulary 39 
13 2 Picture Absurdities II 40 
14 38 Reading and Report 29 
15 4 Finding Reasons I 46 
16 5 Word Naming 40 
17 6 Repeating 6 Digits .... 48 
18 M VIII 1 Comprehension III 76 
19 2 Similarities: 2 Things 85 
20 3 Verbal Absurdities I 76 
21 4 Naming Days of the Week .......................- 84 
ae 5 Problem Situations ...... 74 
23 6 Opposite Analogies II 76 
24 M IX 2 Memory for Designs I ...... 56 
25 z Dissected Sentences I 67 
26 3 Verbal Absurdities IT 52 
27 4 Similarities and Differences ....................-..- 56 
28 5 Rhymes, Old Form 59 
29 6 Repeat 4 Digits Reversed 69 
30 M X 1 Block Counting 40 
31 2 Memory for Stories I 46 
82 8 Verbal Absurdities III 37 
33 4 Abstract Words I 89 
34 5 Word Naming: Animals 52 
35 6 Repeating 6 Digits 52 
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TABLE 8 
Centroid Factor Loadings, Age 9 
Item No. I ll lI IV V v1 he* 
1 558 $—.189 ae ae: 556 
2 722 115 012 342 030 —.110 665 
3 .738 is —1%3 —-61 -—68 12 614 
4 662 .356 172 O71 —097 —086 .610 
5 487 —.098  —.192 .219 129 —.161 874 
6 .648 179 .181 .262 085 275 636 
7 .718 .158 .212 O71 .209 144 .670 
8 306 —.139 847 1394 051 —.087 399 
9 587 —198 —124 —119 —.280 332 576 
10 631 —307 —120 —185 —.096 085 541 
11 til CC Ci‘ 815 .087 587 
12 .740 .184 170 —077 —.098 112 637 
13 398 .282 a2 Cl eC =A 279 
14 594 —.220 a a es P| 527 
15 516 219 —0285 —118 —27 —.049 391 
16 .387 062 001 —334 se 80 6112 363 
17 534 —524 — 306 .298 264 —.156 836 
18 682 146 —.219 160 —158 —. 106 .596 
19 a «wt +07 132 —.250 277 751 
20 .808 150 —176 1188 —291 — (042 807 
21 101 —.822 178060 l 270 «1880+ .739 
22 556 .218 23 —127 179 —.187 .480 
23 44 sc 10 601i = 71 .160 506 
24 481 —.180 813 119 064 245 440 
25 718 —19%5 —01% —209 —009 —1986 647 
26 731 262 .100 .216 051 —.027 .663 
27 .656 119 -—283 —~22 —009 #<=<057 560 
28 .608 102 —242 069 —194 .194 519 
29 AG -—28 —190 —107 221 055 330 
30 367 218 145 278 —298 —.224 414 
31 519 —.079 191 —041 —.097 .197 862 
32 .680 163 110 —138 —0422 —108 582 
33 .600 .052 037 —.161 244 —.342 566 
34 .298 st —S —S5S at 6 A459 
35 365 —463 —.249 896 149 — 3817 689 
Dke 
——— 849 059 .036 044 082 .080 550 
n 
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TABLE 9 
Rotated Factor Loadings, Age 9 
Item No. i hg ir Ill’ IV’ y' he* 
ni 55 07 07 41 —.23 53 
2 AT 58 85 42 18 64 
3 48 52 24 13 07 58 
4 ol 53 —.08 43 18 60 
5 18 28 AT 138 12 85 
6 18 Al 21 51 22 .55 
iz 38 .29 21 51 30 62 
8 —.12 .09 24 56 —.02 39 
9 43 383 28 09 —.25 44 
10 49 20 41 ak —.22 52 
11 46 —.04 53 06 09 51 
12 49 43 .05 42 07 61 
13 28 33 —.11 21 06: 25 
14 .56 2T Fe it | 25 — 11 A8 
15 37 AT —.05 15 —.03 38 
16 50 —.03 .09 07 .26 36 
17 14 18 87 .02 .00 80 
18 27 63 27 14 .06 57 
19 oo 51 42 24) —.22 .65 
20 OT 74 25 .20 —.04 79 
21 64 14 .26 35 —.29 -70 
22 43 Ba Ly § 01 .40 27 45 
23 02 49 —.15 .05 28 45 
24 .20 07 24 51 —.05 87 
25 61 1 32 16 —.13 62 
26 .26 52 19 46 26 .65 
a 56 45 15 01 05 54 
28 30 57 23 .06 —.01 AT 
29 36 —.02 42 .05 04 31 
30 —.03 48 —.04 35 —.06 36 
31 34 .20 13 386 —.11 ol 
82 51 36 .05 .o2 10 51 
33 50 16 ae .23 26 42 
84 45 12 04 —.24 36 Al 
85 —.09 2 -74 09 —.08 59 
Zk 
—- 154 187 .096 089 031 507 
n 
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TABLE 10 
Reference Numbers, Locations on the Stanford-Binet, Names, and Per Cents 
Passing, for Items Administered at Age 7. 







































































Reference Location Per cent 
Number Form, Age, No. Name Passing 
| L' VII 1 Picture Absurdities I 59 
2 2 Similarities: 2 Things 51 
3 3 Coyping Diamond 69 
4 4 Comprehension III 59 
5 5 Opposite Analogies 55 
6 6 Repeating 5 Digits 70 
7 L: VIII 1  # Vocabulary 44 
8 2 Memory for Stories 32 
9 3 Verbal Absurdities I 30 
10 4 Similarities and Differences .....................-- 81 
11 5 Comprehension IV 23 
12 6 Memory for Sentences III 44 
13 M VII 1 Giving Number of Fingers ........................ 81 
14 2 Memory for Sentences II 55 
15 3 Picture Absurdities I 55 
16 4 Repeat 3 Digits Reversed 72 
17 5 Sentence Building I 50 
18 6 Counting Taps 67 
19 M VIII 1 Comprehension III 45 
20 2 Similarities: 2 Things 40 
21 3 Verbal Absurdities I 27 
22 4 Naming Days of the Week .....................-- 43 
23 5 Problem Situations 42 
24 6 Opposite Analogies II 39 
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TABLE 11 
Centroid Factor Loadings, Age 7 
Item No. V6 i II IV yi) 
1 476 —.233 125 166, 106 835 
2 -739 —.463 .283 —.125 —.160. 882 
3 .625 —.079 188 —.107 —.109 488 
4 682 —.172 —.076 —.202 091 .550 
5 .654 173 .067 —.098 —.072 ATT 
6 .565 164 —.253 .297 —.191 | -5385 
ij .649 272 LTT .102 —.137 .556 
8 .620 .168 191 288 —.168 -560 
9 -740 —.140 —.043 172 191, 635 
10 -752 —.313 .227 154 185 757 
11 -754 .256 .170 —.197. .199 -T41 
12 .596 —.103 —.373 AQ. 102 .698 
13 .586 —.328 —.264 —.465 264 . .807 
14 .636 .025 —.190 195 153 503 
15 .684 169 138 —.204 —.062 , 561 
16 -701 364 —.241 —.129. —.052. -701 
17 .674 .162 —.412 —.211 © 103 |. -705 
18 493 —.007 —.329 —.182. —.313.. 482 
19 .655 183 .077 —.127 —.168 A9T 
20 -756 —.233 044 077 —.217 . «197 
21 -770 .255 .100 —.168 336 | .809 
22 .656 —.266 —.337 .059 —.212 . -663 
23 .620 —.109 .302 .073 199 | 582 
24 .691 357 .182 .170 122, 682 
zk2 Fe 
— 4388 .054 .055 .044 081 .622 
n 
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TABLE 12 
Rotated Factor Loadings, Age 7 
Item No. I’ II’ ir’ IV’ h2* 
1 16 52 18 .02 33 
2 .23 84 .00 32 86 
3 38 45 07 .26 42 
4 31 AT 19 44 54 
5 55 27 13 24 AT 
6 37 .16 .56 04 48 
7 65 .28 17 01 53 
8 54 38 .26 —13 52 
9 34 53 .40 17 59 
10 31 16 .19 09 72 
11 72 .29 04 29 69 
12 17 32 .73 06 67 
13 09 38 13 [5 .73 
14 34 .30 49 15 AT 
15 60 30 03 30 54 
16 62 03 36 39 67 
17 42 06 42 55 .66 
18 21 Al 31 47 387 
19 53 30 12 28 A6 
20 41 15 09 10 15 
21 1 .28 12 31 .69 
22 13 1 52 39 61 
23 39 58 05 05 49 
24 13 27 23 —.05 66 
phe 
— 211 .183 094 .088 577 
n 
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RECEIPTS: 
Dues: Members Student Members 
Membership Year No. Amt. Pd. No. Amt. Pd. 
1950 - - - - - 8.05 $ 15.25 
1949 - - - - - 288* 1440.00 28* $84.00 
1948 - - - - - 16 80.00 4 12.00 
1947 - - - - + z 5.00 
1946 - - - - « 1 5.00 
1945 - - - - - 1 5.00 
1944 - - - - - 1 5.00 
1948 - - - - - 1 5.00 
$12.05 $1560.25 82 $96.00 
Total dues received - - - - - = = = = = = = = $1656.25 
Miscellaneous receipts 
Overpayments - - - - - - - - = --- - $13.00 
Repayments for checks returned - - - - - - - 21.00 
Total miscellaneous receipts - - - - - - - - = 34.00 
Total receipts - - - - - - = = = = -=-+ e+ = = $1690.25 
DISBURSEMENTS 
Operating expenses 
Stationery and postage - - - - - - - - - = $ 46.91 
Bank charges - - - - - = = = = = = = = = 2.30 
Psychometric Corporation (90% of dues) - - - - 1490.68 
Total operating expenses - - - - - - - - = = $1540.34 
Miscellaneous disbursements 
Overpayments returned - - - - - - = = = = 13.00 
Returned checks - - - - - - - - = = = = = 21.00 
Total miscellaneous disbursements - - - - - =- = 34.00 
Total Disbursements - - - - - - - - = - = = = $1574.34 
BALANCE 
Excess of receipts over disbursements - - - - - - 115.91 
Adjusted balance** as of June 30,1948 - - - - - 839.10 
Balance, June 30,1949 - - - - - - - = = = = = $955.01 
Bank balance, June 30,1949 - - - - - - - - = = $955.01 
*Includ licants 





**Does not include $1584.00 due Psychometric Corporation on June 30, 1948, but not paid until 
August, 1948. 
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COMMENTS 


There were 220 dues-paying members of the Society in 1947, 279 in 1948, ond 
316 in 1949. The total dues received amounted to $1272.00 in 1947, $1760.00 in 
1948, and $1656.25 in 1949. The larger total for 1948 represents back dues paid 
during that year, mainly by members whose dues had been in arrears during the 
war years. 

Operating expenses, other than the fixed 90 per cent payment to the Psycho- 
metric Corporation, are higher this year only because the Secretary submitted a 
single bill covering his stationery and postage for 1947, 1948, and 1949. These 
expenses are still relatively small. 

The five per cent of one member for 1950 represents a 25-cent over-payment 
returned to a member in Australia in 1948. He said he “kept the check as a curio” 
instead of cashing it, and finally lost it. The 25 cents was therefore credited to- 


ward his 1950 dues. 





























PSYCHOMETRIC CORPORATION 


STATEMENT OF RECEIPTS AND DISBURSEMENTS FOR 
FISCAL YEAR ENDED JUNE 30, 1949 


RECEIPTS: 
Subscriptions: Institutional Individual 
Year No. Amt. Pd. No. Amt. Pd. 
1948 - - - - - - - 10 $ 100.00 1 $5.00 
1949 - - - = - = = 220 2200.00 
1950 - - - - - - - 3 30.00 
233 $2330.00 1 $5.00 
Total subscription payments received - - - - - - - $2335.00 
Payment of balance on 1948 subscription - - - - - - 4.00 
Payments received for back volumes and issues- - - - 980.00 
Total subscriptions and sales, at list price - - - - - $3319.00 
Less agency discounts - - - - - = - - - - = = 249.57 
Net receipts from subscriptions and sales - - - - - $3069.43 
Receipts from Psychometric Society* - - - - - - - 1490.63 
Miscellaneous receipts 
Psychometric Monographs - - - - - - - - - - -  §$ 7.38 
Sale of additional reprints to author - - - - - - - 3.69 
Subscriptions canceled ($30 less agency discount) - - - 27.00 
Overpayments received - - - - - - - - - - - = 57.38 
Society dues paid to Corporation in error - - - - - 23.00 
Total miscellaneous receipts - - - - - - - - - = 118.45 
Total Receipts - - - - - - - - - - - - - - $4678.51 
DISBURSEMENTS 
Operating expenses 
Dentan Printing Company 
Regular quarterly printing - - - - - - - - - = $2140.78 
Extra reprints for author - - - - - - - - - - = 3.69 
Total - - -- ---*+-+e*+-+e+-++--ee = $2144.47 
Secretarial services 
Dorothy Comer - - - - - - - - - - - - - -$ 81.20 
Virgil Greene - - - - - - - - - - = - = = = 17.80 
Hazel Greene - - - - - - = = - - - - - = = 891.89 
Total - = ee ee ee ee ee eee 490.89 
Editorial services (Dorothy Adkins) - - - - - - - - 300.00 
Stationery and postage - - - - - - - - - - - = 200.64 
Treasurer’s bond premium - - - - - - - - - - - 25.00: 
Total operating expenses - - - - - - - - - - = $3161.00 
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Reprinting back issues 


Cooper-Trent Co. - - - - - - - - + -+--+e+es6 3177.52 
Miscellaneous disbursements 
Psychometric Society for dues paidto Corp. - - - - - $23.00 
Overpayments returned - - - - - - - - - = = 59.38** 
Refunds on canceled subscriptions - - - - - - - 27.00 
Total miscellaneous disbursements - - - - - - - = 109.38 
Total disbursements - - - - - - - - - - - = $8336.48 
Excess of receipts over disbursements other than 
for reprinting back issues - - - - - - - = = = $1408.13 
BALANCE 
Adjusted balance* as of June 30, 1948 - - - - - $10105.87 
Excess of disbursements over receipts - - - - - - 1769.39 
Balance, June 30,1949 - - - - - - - = - = +--+ - $ 8336.48 


*$1584.00 due from Psychometric Society June 30, 1948, but not paid until August, 1948, included 
in adjusted balance as of June 39, 1949, and not in 1949 receipts from Society. 
**Includes a $2.00 overpayment of an overpayment returned. 


BANK RECONCILIATION AS OF JUNE 30, 1949 


Balance as per bank statement - - - - - - - - $ 8528.19 

Checks outstanding (7) - - - - - - - - --:. 191.71 

Balance, June 30, 1949 - - - - - - =- - = = = = $ 8336.48 
COMMENTS 


The Corporation took in $4,678.51 this year, as compared with $4,614.22 last 
year and $3,341.64 the year before. Normal disbursements (operating expenses) 
were also higher: $3,161.00 this year as compared with $2,652.81 last year and 
$1,765.49 the year before. 

The largest expense this year was the item of $3,177.52, for reprinting 200 
copies of each of eleven issues of Psychometrika. By doing this we avoided sev- 
eral issues’ going out of print. The demand for back issues may be judged from 
the fact that we sold $980.00 worth of them during the fiscal year. 

The Corporation’s balance dropped from $10,105.87 last year to $8,336.48. If 
the back issues had not been reprinted, it would have risen to $11,514.00. Two 
years ago the balance was $8,144.46, so despite the cost of reprinting, the Cor- 
poration’s balance is now above what it was at that time. 

There were 233 subscriptions this year, as compared to 234.25 last year and 
251 the y-ar before. The last figure includes 52 individual subscriptions; most of 
these subscribers ’:ave since become members of the Psychometric Society. 






































fi 








PSYCHOMETRIKA—VOL. 14, NO. 4 
DECEMBER, 1949 
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Michael Adams, Route 1, Box 246, Bellevue, Wash. 

Sidney Adams, 242 N. Granada St., Arlington, Va. 

C. J. Adcock, Victoria Univ. College, Wellington, New Zealand. 

Dorothy C. Adkins, Dept. of Psychol., Univ. of North Carolina, Chapel Hill, 
N. C. 

Robert B. Ammons, Univ. of Louisville, Louisville, Ky. 

Wade S. Amstutz, R. F. D. No. 1, Yellow Springs, Ohio. 

Oliver F. Anderhalter, 6714 St. Louis Ave., St. Louis, Mo. (last known address) 

Gordon V. Anderson, Testing and Guidance Bureau, Univ. of Texas, Austin, 
Texas. 

T. G. Andrews, Dept. of Psychol., Univ. of Maryland, College Park, Md. 

William H. Angoff, Educ. Testing Service, Box 592, Princeton, N. J. 

Philip Ash, Instructional Film Res. Program, Pennsylvania State College, State 
College, Pa. 

*Andrew R. Baggerley, 95 Prescott St., Cambridge 38, Mass. 

Donald E. Baier, 146 S. Pershing Dr., Arlington, Va. 

A. S. Barr, Dept. of Educ., Univ. of Wisconsin, Madison 6, Wis. 

Brent Baxter, Agencies Res., Div., Prudential Insurance Co., Home Office, New- 

ark, N. J. 

Harold P. Bechtoldt, 148 Riverside Pk., Iowa City, Iowa 

B. J. Bedell, Room 70, Moray House, Holyrood Rd., Edinburgh 8, Scotland 

Ralph C. Bedell, 322 Teachers College, Univ. of Nebraska, Lincoln, Nebr. 

Roger M. Bellows, Dept. of Pers. Methods, Wayne Univ., Detroit 1, Mich. 

*A, W. Bendig, Dept. of Psychol., Univ. of Pittsburgh, Pittsburgh 13, Pa. 
George K. Bennett, Psychological Corp., 522 5th Ave., New York 18, N. Y. 
Corlin O. Beum, 2000-A 38th St., S. E., Washington 20, D. C. 

Albert LeRoy Billig, 1828 Gordon St., Allentown, Pa. 

W. V. Bingham, 1661 Crescent Pl., Washington 9, D. C. 

James E. Birren, 4006 Fordleigh Rd., Baltimore 15, Md. 

Ruth Bishop, 1225 N. Dearborn St., Chicago 10, III. 

Reign H. Bittner, 100 Franklin St., Bldg. 1-C9, Morristown, N. J. 

Paul Blommers, State Univ. of Iowa, Iowa City, Iowa 

Frances Blumenthal, 6 Landscape Ave., Yonkers 5, N. Y. 

Edward S. Bordin, Bureau of Psychol. Services, 1027 E. Huron St., Ann Arbor, 
Mich. 

Henry Borow, The General College, Univ. of Minnesota, Minneapolis 14, Minn. 

Rev. W. A. Botzum, c/o Univ. of Notre Dame, Notre Dame, Ind. 

G. D. Bradshaw, Commonwealth Employment Serv., Box 2715 G. P. O., Syd- 
ney, Australia 

Thomas L. Bransford, Examinations Div., State Dept. of Civil Service, Albany, 
Ns Ys 

Robert E. Breden, Pers. Res. Dept., Procter and Gamble Co., Sixth and Main 
St., Cincinnati, Ohio 

Claude F. Bridges, 6 Livingston Ave., Yonkers 5, N. Y. 

Hubert E. Brogden, Pers. Res. Section, AGO, Pentagon, Washington 25, D. C. 

Cecil Brolyer, Div. of Exam., N. Y. State Dept. of Civil Service, Albany, N. Y. 

Daniel F. Brophy, Dept. of Student Life, College of the City of New York., 
139th St. & Convent Ave., New York 31, N. Y. 
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Theodore H. Brown, Soldiers Field Rd., Harvard Business School, Boston 63, 
Mass. 

Mrs. Virginia M. Brown, 1700 E. Tuft Ave., Englewood, Colo. 

Joseph G. Bryan, 97 Green St., Melrose, Mass. 

Guy E. Buckingham, Allegheny College, Meadville, Pa. 

Hermann F. Buegel, Univ. of North Dakota, Box 114, Grand Forks, N. D. 

Laverne K. Burke, 2118 N. Glebe Road, Arlington, Va. 

William W. Burke, School of Social Work, Washington Univ., St. Louis. Mo. 

Oscar K. Buros, 220 Montgomery St., Highland Park, N. J. 

Siz Cyril Burt, Dept. of Psychol., Univ. College, Gower St., W. C. 1, London, 
England 

Harold E. Burtt, Dept. of Psychol., Ohio State Univ., Columbus 10, Ohio 

Roy C. Busch, 5022 Corby St., Omaha 4, Nebr. 

Hobart Bushey, Math. Dept., Hunter College, Lexington Ave. & 68th St., New 
York 21, N. Y. 

John B. Carroll, 40 Quincy St., Cambridge 38, Mass. 

Harold D. Carter, 10 E. Parnassus St., Berkeley 8, Calif. 

Launor F. Carter, Dept. of Psychol., Univ. of Rochester, Rochester 8, N. Y. 

Teobaldo Casanova, Univ. of Puerto Rico, Rio Piedras, Puerto Rico 

Robert L. Chapman, Dunlap and Associates, Inc., 10 E. 49th St., New York 
17, N.Y. 

Henry Chauncey, Educ. Testing Service, Box 592, Princeton, N. J. 

Lin Chen, Laboratory of Psychology, Nat’] Chekiang Univ., Hangchow, China 

Herbert H. Coburn, 80 Arden St., New York 34, I. Y. 

Jozef B. Cohen, Dept. of Psychol., Univ. of Illinois, Urbana, III. 

Andrew Laurence Comrey, Jr., Dept. of Psychol., Univ. of Illinois, Urbana, II. 

Herbert S. Conrad, Res. and Stat. Service, U. S. Office of Education, Washing- 
ton 25, D. C. 

Ellsworth Barrett Cook, USN, U. S. Naval Med. Res. Lab., U. S. Navai Sub- 
marine Base, New London, Conn. 

Clyde H. Coombs, Dept. of Psychol., Univ. of Michigan, Ann Arbor, Mich. 

Herman A. Copeland, 543 Overlook Road, Philadelphia 28, Pa. 

*Sarah Counts, 5416 Harper Ave., Chicago 15, Ill. 

John T. Cowles, Educ. Testing Service, Box 592, Princeton, N. J. 

Gertrude M. Cox, North Carolina State College of Agric. and Engineering, Ral- 
eigh, N. C. 

H. M. Cox, Univ. of Nebraska, Lincoln 8, Nebr. 

Clarke W. Crannell, 120 S. Main St., Oxford, Ohio 

William J. E. Crissy, 51-01 39th Ave., Sunnyside, Long Island, N. Y. 

Joan H. Criswell, 2728 32 St., N. W., Washington 8, D. C. 

Lee J. Cronbach, Bureau of Res. and Serv., College of Educ., Univ. of IIl., 
Urbana, Ill. 

Dorothea J. Crook, Psychol. Dept., Tufts College, Medford 55, Mass. 

Elmer K. Culler, Lab. of Psychol., River Campus, Univ. of Rochester, Roches- 
ter 3, N. Y. 

E. E. Cureton, 853 E. Brewster Rd., Alcoa, Tenn. 

Louise W. Cureton, 853 E. Brewster Rd., Alcoa, Tenn. 

Manuel Cynamon, 10 Avenue P, Brooklyn 4, N. Y. 

John T. Daily, Psychol. Res. Exam. Unit, Sqn. E, Indoctrination Div., Air 
Trng. Comm., San Antonio, Texas 

Karl M. Dallenbach, 2106 Meadowbrook Drive, Austin, Texas. 
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G. Darmois, Institut de Statistique de L’Universite de Paris, Secretariat Gen- 
eral, 11 Rue Pierre-Curie, Paris Ve, France. 
Melvin D. Davidoff, 3233-B Terrace Drive, Washington 20, D. C. 
Frederick B. Davis, Educ. Clinic, Hunter College, 695 Park Ave., New York 
ay eX, 
Hugh M. Davison, 419 Martin Terrace, State College, Pa. 
Walter L. Deemer, Jr., 400 Cameron Ave., Chapel Hill, N. C. 
James W. Degan, 1128 E. 61st St., Chicago 37, IIl. 
J. C. Denton, Jr., 4760 N. High St., Apt. D., Columbus 2, Ohio 
Jerome E. Doppelt, 2165 Ryer Ave., New York 57, N. Y. 
Paul L. Dressel, Dir. Counseling and Chairman, Board of Exam., Mich. State 
College, East Lansing, Mich. 
Philip H. Dubois, Dept. of Psychol., Washington Univ., St. Louis 5, Mo. 
Jack W. Dunlap, Lockwood Rd., Riverside, Conn. 
Paul S. Dwyer, 640 Oxford Rd., Ann Arbor, Mich. 
Henry Dyer, 25 Dwight St., Brookline 46, Mass. 
Robert L. Ebel, Room 114, Univ. Hall, Iowa City, Iowa 
Harold Edgerton, Box 51, Cross River, N. Y. 
Mrs. Daisy M. Edwards, 1 Oakfield Court, Queens Rd., Weybridge, Surrey, Eng- 
land 
*Richard Henry Ehmer, Dept. of Psychol., Univ. of Rochester, Rochester 3, N. Y. 
William G. Emmett, Moray House, Edinburgh 8, Scotland. 
Max D. Engelhart, 5427 Greenwood Ave., Chicago 15, IIl. 
Mrs. Katherine W. Estes, Dept. of Psychol., Indiana Univ., Bloomington, Ind. 
Harold T. Fagin, 8891 Twentieth Ave., Brooklyn 14, N. Y. 
Leonard W. Ferguson, Pers. Res. Section, Field Training Div., Metropolitan 
Life Ins. Co., 1 Madison Ave., New York 10, N. Y. 
Samuel W. Fernberger, College Hall, Univ. of Pennsylvania, Philadelphia, 4, Pa. 
George H. Fettus, 10 South Baltimore Ave., Ventnor, N. J. 
Warren G. Findley, Educ. Testing Service, Box 592, Princeton, N. J. 
O. Fischer, Plavecka 10, Praha 11, Czechoslovakia 
John C. Flanagan, Dept. of Psychol., Univ. of Pittsburgh, Pittsburgh 13, Pa. 
Paul M. Freeman, Edue. Advisory Staff, Air Tactical School, Tyndall A.F. B., 
Fla. 
John W. French, Educ. Testing Service, Box 592, Princeton, N. J. 
Benjamin Fruchter, 1216 Norwood Rd., Austin, Texas 
Edmund F. Fuchs, 211 - 16 St., N. E., Washington 2, D. C. 
N. L. Gage, Bureau of Res. and Service, College of Educ., Univ. of Illinois, 
Urbana, IIl. 
Henrietta L. Gallagher, 48 Wiggins St., Princeton, N. J. 
Eric F. Gardner, Asst. Prof. Educ. Statistics, Syracuse Univ., Syracuse 10, 
N. Y. 
Henry E. Garrett, Dept. of Psychol., Columbia Univ., New York 27, N. Y. 
Richard H. Gaylord, Pers. Res. Section, AGO, Pentagon, Washington 25, D. C. 
Frederick Gehlman, 1036 Shady Lane, Flowerfield, Lombard, Il. 
Charles P. Gershenson, Box 130, Teachers College, Columbia Univ., New York 
a Oa ae 
Jerome H. Gibson, 2957 Santa Clara Dr., Albuquerque, N. M. 
*Wilfred A. Gibson, 5245 Ellis Ave., Chicago 15, Ill. 
John G. Gleason, Apartment E 2, Bldg. 5, Franklin Manor, Morristown, N. J. 
Alfred F. Glixman, Dept. of Psychol., Univ. of Kansas, Lawrence, Kan. 
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*Howard W. Goheen, 2803 16th Rd., Arlington, Va. 

*Leonard V. Gordon, Dept. of Psychol., Ohio State Univ., Columbus, Ohio 
David A. Grant, Dept. of Psychol., Univ. of Wisconsin, Madison 6, Wis. 
Donald L. Grant, 101 E. 13th Ave., Columbus 1, Ohio 
J. Douglas Grant, 2504 Jackson St., San Francisco 15, Calif. 

Clyde H. Graves, 23 Oak Ave., Hempstead, Long Island, N. Y. 
Bert F. Green, Jr., Educ. Testing Service, Box 592, Princeton, N. J. 
Russel F. Green, 633 N. Benton Way, Los Angeles 26, Calif. 
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William W. Grings, Dept. of Psychol., Univ. of Southern Calif., Los Angeles 
7, Calif. 
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